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0*0 Summary 

This memo describes a notation and a program! ng 
language for expressing/ from within a LISP system, 
string manipulations such as those performed In C0M1T, 
The COM IT formalism ha:; been extended In several ways: 
the patterns (the left -ha If const! tuents of COM IT 
terminology) can be variable names or the rrsults o f 
computation; predicates can be associated with these 
elementary patterns allowing .more precise specification 
of the segments they match; the names of elementary 
patterns themselves nay be variable or the results of 
computation; it Is no longer necessary to restrict the 
operations to a linear string of characters (or words) 
since elementary patterns c*n themselves match 
structures; etc, Sim! lar generalizations ex I st for 
formats, I.e. what corresponds to the right-half of 
the COM IT rule. 

The language has been Implemented as a collection of 
LISP functions. Used as a single subroutine/ the 
result 1 ng system perm: ts a marriage of LISP and 
COM IT- type notation. It Is designed so that It can be 
used by the novice with little or no Information about 
the deta! Is of t ts operation* However/* the 

modularization of the system al so al lows the 
sophisticated user to exercise partial or complete 
control over the way In which it operates. In 

addition/ he can easily expand it by defining new LIS? 
functions* 
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limited comparisons Irdlcate a LISP compiled function 
win run only about t*!ce as fast ^s a FLIP stater^nt 
to perform the sane tas*<* Much t'me Is ssverf by 

wrl ting and debusing In FLIP* I nstead of coding 
directly In LISP, In addition, FLIP r^os are usually 
more economical In spcce. 

Mac Memo 26^ describes a LISP Edit function that u$*s 
FLIP to permit editing while Inside of a LISP system 
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1.0 Introduction 









LISP Is a very powerful symbol-manl pulatl n*; programming language 
However/ there are certain types o* pre b lews for which the 
explicit function-oriented nature of LISP requires lengthy coding 

which 1$ difficult to prepare and to understand when read* C*l") 

■ 

These problems have been described uncier var'ous headings: 
search procedures, pars I ng, str I ng wan\ pulat Jon, etc. 3est cal i y, 
these problems require locaclr.g certain substructures In a \arz& r 
structure, either to ascertain their presence, to find their 
value/ or, as Is more usual,* to utilize thf*m in assembling other 
structures* 

"Such transformations may be characterized (and carl catur Ized) by 
the fol!ow T ng I nst ructions for a transformation: 

Find In this string th* substring consisting of the 
three elements Inm*d! ately pr ecod I ng the first 
occurrence of an A, an»i find the element just before an 
occurence of a B wMc-T follows these three elements; 
If such elements ex*.st,> exchange the position of the 
three elements and the one element, delete the A, and 
replace the B by a C." C-2-) 

The LIS? formalism cannot easily express such processes/ although 
each can be individually programmed (If only because LISP Is 
una versal ) , 

The first attempt to deal with this tyoe of problem In any 
systematic way arose In the use of computers In linguistics. 
This resulted In the development of the programnlng language 
COMIT, whl ch Is bul 1 1 around a notation for express! ng 
transforations such as the one above* It consists of a formal 
method for select! ng substri ngs from a strl ng/ and then 
Indicating the structure of the transformed string. As an 
Illustration, the COMIT rule for the transformation above would 
be: 

$ * *3 * A * I * tl +'• + t * 1 + S + * + 2 + C ♦ 7 



(-1-) Section 2* 2 contal ns ar excel! e rt . t example of such a 
function. It performs the transforation described (n 'the Inset 
on thl s page. 

C-2-) 3obrow, 0. G, "METEOR: A LIS Interpreter for String 
Transformation," The Programming Language LISP; Its Operations 
and Application, P* 16i. 
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However/ COMIT (s designed i:o operate on strings of words* t.n- 
linear lists, and suffers b.jdly in dealing wl th msre complicated 
structures. For exartip^e, there Is no way to realize groupings 
such as those Indicated by parentheses In LiSP except by using 
special subroutines to separate out substrings tf| th balanced 
parentheses tand subroutine linkage Is p*r;<cu!arly cumbersome*. 
Since working in COMIT also precludes the use of the flexIbUI :y 
and recursive power of LISP,, most users prefer to forego tNe 
convenience of tha COMIT notion and work entirely In LIS* wh*n 
they have a problem which requires some of the powers of both* 

Because this latter contingency Is ar 'sins mora and more 
frequently/ especially 1 n conjunct' on wl th problem solving 
systems which deal with natural language Input/ a language 
which statements In both MSP functional notation ?nd COMIT 
prototype notation are T ntorpretable Is becoming Increasingly 
desl rable* 

Qobrow attempted to resolve this problem In conjunction with 
STUDENT (-3-) by embedding JIOMiT tn LISP via METEOR, a LISP 
program which Interprets COMtT-type rules. <-b-0 



(3) D. G, Sobrow/ Natural Language Input for a Computer Problem 
Solvlrg-System M # I.T# Project MAC,- MAC-TR-3. 

{<*) It is unfair to dismiss METEOR as a mere translation of 
COMIT formalism Into LtS D * Many of the features cf FLIP we?*e 
anticipated by METEOR/ and slmPariy, T ts def !cl ts aid 
shortcomings sussested some of the more sophisticated some of t^e 
powers of PL!P. However, i *; suffers from u defect common to such 
first generation efforts - an overdose of nd-hocness, Sut for 

this and a lack of flexibility CMETF.OR was not designed for easy 
modifications or Introducing new conventions), M£TEOR might well 
possess a1 1 of the properties th^t n*ot!v*}t?d the design and 
Implementation of FLIP* As It Is, It did orov'de a 

starting-point for Its design and a yardstick for evaluating it. 
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There have also been several attempts Involving the design of now 
languages. These Include the work of Mcintosh (-5*)/ and the 
proposed LISP II matching feature (-S->* As a rule, these 
languages are all subject to one or more of the following 
crl tlolsms. 

Firsts the formalisms are rigid and cannot easily be modified or 
expon<Ied. Usually, there <iVQ certain basts primitives which may 
not &** tampered with. In addition/ none of these languages allow 
the u:ser to specify arbitrary components >f a pattern as the 
result of a computation performed while tha match! ns process Is 
taking p'ace. 

Secondly, these languages are usual ly Interpret* v«, and 
accordingly slow. They therefore have little or no appeal to the 
sophisticated programmer who feels tftat ha sacrifices more in 
efficiency and running spaed than he gains ^ror? t ease of writing. 

Finally/ It Is difficult for the user to affect the Internal 
process and exercise control over the manner In wh! ch the 
match* ng procedure Is carried out* 

The formalism and implenentatlon of FLIP raflect a concern for 
these problems. The ain was to develop a facility within LISP 
which allowed the user to specify sophisticated search/parsing 
procedures in a way that was both flexible ar.i fast, and which 
could be used without detailed knowledge o* the program* The 

resul* o* embedding FLIP inside of LISP Is not only an Increase 
In th.j scope of LISP, but It also permits : L1P to make use of the 
full powers of LISP, 



(-5-) CONVERT, H,V,Kclntosh, Instituto PolUecnlco Naclonel, 
Centro de Investigation y de Es tudlos Avanzados. This Is a 
collection of LISP functiors similar in Intent to FLIP, 

(-6-) Sorrow, D,G, "The COMIT Feature In -ISP N," Wac Memo 219, 
This Is a proposal for a COMlT-type f eatur 9 w! thin LtSP 11/ and 
contains some of the generalizations of METEOR found In FLIP. 
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In the current FLIP system/ the novlcs user can remain almost 
totally Ignorant of the nuances ov I ts construction 
operation, and still utilise many of lis more sophistic^ w 
features. This is because all of the basic, more commonly usod 
features have been standardized and made nc rationally simple* 

At the same tine, there ext«;t many variations which provide the 
sophisticated programmer wl*:h nc^e flexibility and power. There 
are also facilities for allowing Mm to cort^ol the operation of 
the system, 8y defining new operations, he c?n augment the 
language. By monitoring tho execution of existing one?;/ he can 
Increase the efficiency of .» FLIP program *s much as he desires 
up to and I ncludlng wrt t : ng portions of it In machine language. 

Both the neophyte ani sophisticate will realise the benefits 
derived from the fact that nstruetlons to FLIP specify goals 
(l»e« the segments of the list structure that ore wishes to 
locate), as opposed to conventional i nstructlons to computers, 
which specify methods* Tht:; ms'<es it m;c^ easier to detect 
logical errors In the program (especially when the selective 
trace feature *s used.) The result Is that the time r^qu'rei to 
construct an unfamiliar cr loglc-iaHy complicated algorithm ^?y 
still be long^ but mostly for the ?!^*ni r # c steps, not for 
preparing the program. 

The FLiP system In Its current state of evolution *s far from the 
final word In format processing languages, ^t Includes many 

features we have found desirable or necessary, at\i 1$, certainly 
developed to the point whom It Is usefu 1 <*s It stands, 3ut It Is 
by no means presented as a Mnlshed produc :, and Its design Is 
Intended to encourage modification and expons'o^* What the user 
shoulc bear In mind while reading this paper 's that FLIP Is 
Intenced to be a notstlonal base and a pro^raTml ng system from 
which one can build more Interesting, sophisticated, an*i usefjl 
functions^ The operations sullc Into FLIP are examples of what 
can be done, not necessarily what $J*ould be done. 

The baste operation of FLIP consists of a Hatching process and a 
construction process. These correspond to colls to two functions, 
MATCH and CONSTRUCT, specifying for the former, a list structure 
and a pattern, and for the latter, a match and a format. Soth the 
pattern and the fornat are assumed to be translated Into Interna! 
representations usnd by MATCH and CONSTRUCT* Two functions are 
provided for this translation process/ PATTRAN and FORMTRAN* 
Finally a top level function, FLIP, is provl -^.ed which given an 
Input list, a pattern, and a format, performs the, necessary 
trans 1 at Ions, match I ng, and construct! ng, ond returns the valyp 
of both the match and construct. We discuss these In greater 
dctal 1 below. 
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2 # The Match 



The purpose o* Che matching process Is to determine whether or 
not an input list is an instance o5 a part r cular (Input) pattern* 
If It Is, the match process Is designed to te!l us this and also 
to yield a parsing of the list with respect to this pattern. 
This psrs-ng can then be used by the construct process to build 
new list structures. 

The pattern mentioned here Is a list of elementary patterns, and 
each of these must rratch a portion of the Input Hit/ or else the 
entire pattern will not rrstch the list. Furthermore, these 
portions, or segments as they will be called, must together, and 
taken n order, make up the entire Input list. This set of 
segments will then constitute the parsing o* this list. As an 

example, lot us consider some patterns composed of three of the 
elenonuary patterns from COMIT* These are* 

$ which matches anything; 

Sn which matches a segment of longth n; 

x which matches x, i,e* a segment of length i consisting 

of a single Item equal to x* 

If our Inpi't list is (A S C 0) and the pattern Is ($ 9 $>, a 
match occurs with the $ matching CAJ, S matching [83/ and the 
final t matching [C 03. (-7-) If we did not have the final 5 Tn 
the pattern, there would be no match because there Is no way for 
the segments matched by the First S and the 3 alone to make up 
the entire list. If the pattern were (S 0) however/ we could have 
a match with [A 3 CI [0] the corresponding ^egnents. Note that 
If the pattern were CS $), the parsing would be CA 3 C3 (0) £J, 
the last $ matching the null segment U . 

Another example: let (A 3 C i) E F G) be the Input list and (S SI 
D $) the pattern. In this case [A BJ [C] [[*] (£ F GJ Is the 
par$\r>z, with $ matching the first segment/ SI the second, etc. 
If we were to return to the oxample In the Introduction, where 
the pattern was <$ S3 A $ $1 B $), and use the list (A W X Y Z A 
B C E 3 C D), the parsing would be [A WJ [X Y Zl {A) EB C 03 
CEI [B3 tC D3. Note that the A pattern d;d not match the first A, 
because the S3 pattern must first f'nd a segment of length 3, 
Similarly, B does not match v/i th the first S afte*- the second A 
because there must be at leas-t 1 Item between them to satisfy the 
$1 pattern. 



****+***********#******«i 



(-7-) We wt 1 1 use the notation [,.] to denote a segment of a 
list. The internal representation of these segments Is not 
Important here/ but will be discussed in section 2,1,2* 
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These are sorie simple examples* Section 2,1/ which define* n V: 
elementary patterns and discusses t'^cm In detail, will fntroduCG 
some Jn^re complicated examples In the course of the exposition; 
Section 2*2 contains some corop&r I so^s between Ft t P and LISP/ 
Including an ex~reme*y sophist! cated (and corcpl ! ceted) e> 
showing the power of FLIP. The renalnder of section 2 contains 
the translation from source language *r\xo the Interna? 
representation of pat t errs. In 2.3; the various modes of 
operation. In 2.**; an£ finally/ in 2*5/ s description of the 
operation and purpose of each of the functions used by the match/ 
and the method of defining new elementary patterns. 



2.1 Elementary Patterns 



2*1.1 An Introduction 

Sefore proceeding to the formal treatment of the elenentary 

patter is, we will try to give the prospective user the flavor of 

the match and type of patterns It uses. This will of necessity be 
only an Incomplete Introduction. 

We haw already Introduced three of the patterns In FUP's 
repertol re, I.e., the three COM IT patterns 5/ $0/ and *. 
Nothing, more needs to be s*?d about $ or 5i at this point except 
that they will be considerably extended In sect'on 2.1.2, For 
example, the user wll be allowed to specify n as a variable cr 
the result of a computation/ and will also be allowed tc 
associate predicates with these patterns which the segments they 
match nust then satisfy. 

The u x" pattern In the previous section Is an Instance of a more 
general pattern. Above, x matched something equal to I tse!f . It 
Is sometimes useful to have x match something equal to the value 
of Itself/ Ue, to treat x as a variable* -or example/ If the 
value of x Is (A 8 C), then If WS Is CW X Y Z {A 3 C) D) zn6 PATT 
Is (S X s <* X) $), (-8-) the parsing I* CM W EY ZJ ECA 3 C)3 
ID], 



•*#»*** #*********»** 



(-8-) WS and PATT are the nanes of the arsunents of the function 
MATCH # WS stands for workspace, a term Inherited from CO.vlT, and 
Is the list beina matched, PATT Is the pattern. 



*\ 
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When just "x M appears In PATT, It Is called an <sexp>, fcr 
S-exprsssIon. When one writes C* x), this Is called 3 <form? . 
One cai also Indicate the result of a computation/ by writing 

(■ <fn> <var> ... <ver>). Th*s Is also a <forn>. Fcr 

exanpJ^ If PATT ware IS X S ( 8 CAR (- X>) $>, and X were (A B C) 
as before, the result of the match would be [Wl IX] [Y ZJ [A] (B 
C 03. Remember: the value cf an <sexp> is always Itself; tfe 
value of a <form> Is the result of a LISP comp^tat Ton, For 

example, the value of A Is equal to the value of <• CAR (A 8 O). 

Both an <sexp> and a <forrn> are examples of something called a 
<var>. When a <var> appears by Itself In PAfT, It represents on 
elementary pattern called a <varp> (for variable pattern), and It 
m atc hes sone^thjjig e r qu_aj to the value of the <yar > , If the <var> 
is an "<sexp>, this Is the <sexp> ftself. If" the <var> Is a 
<form>. It Is the value resulting from a computet' on* 

In the examoles above/ "matching something equal to Itself" was 
taken Co mean matching a se&ment of length 1 consisting of a 
single I tern equal to the value of the <vor>. If the value of X is 
(A B C), WS Is (X A B C (A B C) (3 C D) X Y Z>, and ?ATT Is ($ 
(■ X) S>, then the <varp> <whlch In this case Is a <form>> 
matches the (A B C>, I.e.- the parsing Is [X A B C 0J t (A 3 C)3 
C<8 C )) X Y 21. In this cas?, the value of the <var> Is treated 
as a s! ngle I tern. 

It Is slso possible to make FLIP treat a <var> as a segment. This 
Is don* by using the special symbol M *»". Then If WS were (X A B 
C D (A B C) (B C 0) X Y Z>, and PATT (S <** <« X)) $), t^e 
parsing produced would be Ui t.A _3_CJ ED CA 5 C) (3 C D) X Y Zj, 

In general a <varp> carries with It the specification of whether 
the value of the <var> Is to be treated as a segment or Item, 
with ** denoting segment anc* * I tern* However, FLIP always treats 
an <sexp> and a <form> as Items unless otherwise specified, so 
that/ "or example {» x> »$ the same as (* (- X)) # 



The reader may have noted that the definition of the <dol> 
elementary pattern Is no' complete (<dol> Is the name of the 
elementary pattern denoted by $>* For example, suppose WS Is (A 
B C C D E> and PATT Is ($ C $). According to the above 
definition both [A BJ tCJ [C C D E] and [A B C D3 [C] CD EJ are 
possible matches. This ambiguity will not arise In practice 
because the operation of the match is a sequential, ' ef t-to-rl ght 
process. Thus the first match will be the one that is found. 

Normally, one does not consider the match process as a series of 
distinct operations* One of the niceties of a format processing 
language is precisely th* t the user ggj} specify a search 
procedure In terms of the structures being searched for, and not 
be concerned about the details of the search. This nakes the 
language more-or-less go*l oriented. However, for some purposes. 
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It Is ieslrable to think of the matching process (and t>& 
constrjctlng process) as proceeding from left to right/ with each 
elementary pattern psrformlrg a certain ope^aElon on the partial 
match/ WS/ all st/ etc* 

This latter conceptual Izatlcn ts not without Its rewards* Since 
the naich does proceed from left to rinht/ at the time any 
particj^ar elementary pattern is operattns* all the elementary 
patterns to the left of Its portion In PA7T have already been 
matched with acceptable segments (or th!s pattern would never 
have been reachod)/ and these can therefore be referenced* This 
Is done by the use of a <mark>. A <mark> refers to a particular 
elementary pattern In PATT/ and the value of a <^ark> Is the 
value of that pattern. I.e. the segment th?t It matches. 

A <mark> !s also a <var> and thus a <mark> appearing by Itself Is 
a <varp>* This means that it matches something eoual to Its 
value* In the case of a <marfc>/ unless otherwise specified Fti; 
treats It as a segment/ contrary to <form>*s and <sexp>'s so th^t 
(** <Tark>) Is tho same as <mark> by itself* TMs Is usually the 
desired Interpretation* for example/ suppose we wish to find the 
first repeated I tern !n WS* The pattern we would use would be IS 
$1 $ 2 $)• "2" Is a <mar'<>* It refers to the value of the second 
elemertary pattern (l*e* th^a segment the S3* matches). Let us 
trace the operation of the match for WS (A 3 C D E B F). 

InltUlly, <do1> (the S oat:ern) matches t; , and SI matches [A], 
The second <dol> also matches C] and the <nark> tries to mat:.h 
with IB3. The value of the Cnark> is CAJ/ because CA] Is the* 
seiner t matched by the SI* S'nce [A3 does not ec.ual (53/ the 
match falls. Then second <dol> maters with E&l. Mow the <marfc> 
tries to patch with (C3 • Again the -natch fall's* This continues 
.until the second <dol> matcies with EB C D E 8] * <mark> tries to 
nftrtch with [fl end falls* <Jol> matches [B C D E B ?]/ and <mark> 
falls again (this ttrne becajr*^ there Is nothing left In W3), and 
now <c!ol> also falls* What happens then Is that the first <dol>/ 
which matched [3 Initially now matches EA3,* the <dotn> (^he Sn 
elementary pattern) then matches t5j/ and :he second <dot> again 
startr^by matching U* Now the value of <mark> !s EB] * <mark> 

tries to match with £C3/ but since tB] doe*; not equal [C3 !t docs 
not succeed. This continues until the second <dol> Is matching 
tC E]* At this point/ <mark> tries to match with ES3 and 
succeeds/ and the final parstns Is CA] EB3 EC £] £33 EF3 * 

Similarly If we used PATT ($ S? S 2 5> and WS (A B C A C B AC 
0)/ the <mark> would ultimately match EA C3, and the parsing 
would be CA B C] [A C] TBI [A C] CD]. Note that the second 

segment/ the one corresponding to <doln>/ : s equal to the one 
correspond! ng to the <mark> * 

This latter example demonstrates why It is desirable to have FLIP 
treat <mark>'s as segments* Here the value of the segment matched 
by the <doln> was TA 83* If this h,?d been treats as an Item* 
<mark> would h?ve attempted to match with the segment ((A 3)3/ 
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(because EA 3] Is represented Internally as (A B)) and not tie 
segmer t [A 3] . 

For example/ If WS were (A I) C D E A 3 E F (A B) (B 0)> and PATT 
(S 52 S 2 S) a match wouM occur with S2 Pitching (A B2 and 2 
matching [A BJ, I.e./ the parsing would be [J EA 3 J EC D E] tA 33 
£E F (A B) (B 0)3. However,. If 2 were treated as an I tem. I.e. 
If we wrote ($ S2 S t* 2) $) (recall that we use "* lf to denote 
single items), then S2 would still match EA B] but (* 2) would 
match [(A &)1, I.e. the segment consisting of the single I ten tA 
B). The parsing wou!d bo El [A BJ CC E t. 9 E Fl E<A B _)J tt2 
D)J. Th!s will become clearer when we discuss the Internal 
representation of segments and the evaluation of toarW's. 



Since the segment interpretation of <mar f <>'s Is usually Intended/ 
this Is what FL i P assumes to be the <:ase unless specified 
otherwise. Th's .philosophy has prevailed throughout the 

development of FLIP# We provide a way of expressing the 

Intention of the user precisely (here by using either * or **), 
and furthermore, have an abbreviated representation for the more 
common usage. 

Since one of the advantages of working In LISP Is the ability to 
handle complicated structures, we want to itillze FLIP rules to 
match nonlinear lists. An elementary pattern which achieves this 
effect is the suboattern or <pattern>, A <pattern> matches a 
single I tern which Is a list In the same way that PATT matches the 
top level list WS. 

As an example, let WS be (A (B C) D (3 E F> G) and PATT (S (S F 
$) $), then a natch will occur with the first <dol> matching EA 
<B C) 0], the <pattcrn> matching E(3 £ F)l, because (B E F) 
matches (S F $), a^<l the la;t <dol> matching [GJ. Furthermore 
the Irternal representation of E(B E F)3 reflects the fact that 
It has been Hatched by a <p»ttern>, and also Includes the parsing 
with respect to that pattern. One can visualize the entire 

parsing as EA (B C) DJ Et3 ll EFJ [13 EGJ . The segment that the 
<pattern> matches is stMI £(8 E F)J/ and that Is the value of 
<pattem> If a <marfc> refers to It, but the parsing Is available 
so that <mark>'s can also refer to segments corresponding to 
elementary patterns contained Inside of a <pattern>. 

If PATT Is (S ($1 $2 $) $ (/T 2 1)) and WS is (X Y Z (A 3) (3 C 
D) E F G B Y), a match occurs with <pattern> matching [(3 C 0)1 
and the <nark> (/T 2 1) matching CBj , The C/T 2 1) refers to the 
first elementary <pattern> Inside the second elementary pattern, 
namely the SI In <$1 $2 $) and this matches with EB} In (8 C 0). 
Similarly, one can write (QUOTIENT SI (TIMES S 2 $)) as a pattern 
for determining whether or not a quotient (In LISP formalism) has 
a common factor In It. The 2 then refers to the $1 because this 
Is the second elementary pattern in PATT at the top level*. More 
will be said about this later. 
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At this point we shall Introduce a format *nd concise notation*! 
definition of the elercentar/ patterns, which have been Introduced 
above In a very sketchy roanier. Many gencr al Iz*tlon$ hav^ be*n 
omitted. For example/ It !s possible to Indicate wl th a <mar<> a 
reference to the top lev?l <pattern> or the current lev?? 
<pattcrn> or to court backwards from the present elcnenta-y 
pattern/ etc* Similarly on* can rep'ace the numbers In a <mar<> 
with the result of a computation, l«e* a <*"orm>* A <patt*rn> can 
also be the resu't of computation, or even the evaluation o^ a 
<mark)/ and can refer to s events as well as single Items. In 
fact, a user who needs a particularly exot c elementary pattern 
has a very good chaice that soriu combination of the 
generalizations In the ief! nit Ions be'ow wMl fulf U 1 his 
purpose. Otherwise, he can always define a new elementary pattern 
as discussed In section 2.5. 
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2,1*2 Notatloi and Definitions 



In this section wc give a syntactic definition of the match 
poftlcn of the FLIP language* "The definition Is given In Backvs 
notation with the addl tlon of three dots (...) to avo'd naming 
unnecessary syntactic types* 

In Backus notation the symbols "::■", "<", ">", and "I" are used* 
The rule: ' 

<S-express T on> : ;* < atomic symbo1>| ( <S-exp * ess 1 on>*<S- express I on>) 

means that an S-expresslon Is either an atomic symbol, or It Is 
(sic) a left parenthesis fol lowed by an S-^xpression fol lowed by 
a dot fol Towod by an S -express! on fol low^d by a rl gh t 
parentheses. The vert I cal bar means H or w , and the angular 
brackets a!wavs enclose elements of the !>vntax that Is being 
defined/' (-9-) 



i* <ep>.::« <elem»ntary pattern>; 

<ep>"' ::= the sogftent matched by <ep>; 

<ep> v ::= the internal representation of <ep>"' (also 
called the value of <ep>). 

if <ep> M Is [J, <ep>* Is HK; If <ep>~* Is ;SJ, <ep> v Is (S); if 
<ep> H Is fSl S2 .„ Sn], <e:> v Is (SI $2 .,. Sn)* Note that this 
allows the distinction between an <ep> thai matches a secment [A 
B), whence <ep> ■ (A B), and an <ep> matching a segment E(A 
B)J, whence <ep> v = ((A 3,'K Similarly, if <ep> matches U, than 
<ep> v is NIL/ while If <ep> matches [NIL], then <ep> v Is (NIL), 

We will define an <ep> by giving Its value, I.e., the Internal 
representation of the segment It matches* Thus In xxl i <varp> v * 
(<var> ) means <varp> matches a segment whose Internal 
representation Is (<var>") / which Implies t;hat it Is a segment 
consisting of the single I ten <var> v . In xxltlj <varp> v ■ <va-*> ,/ 
means <varp> matches a segment whose Internal representation ts 
<var> v * Therefore, If <var>* Is (X Y Z) r ^var?> will *atch [X Y 
ZJ; if <var>* i$ CCX Y Z)), <varp> will match £<X Y 2)]. 

II* <var> :: = <sexp>; <var>* ::■ <sexp> v 



r******** ** ************ 



(-9-) LISP 1.5 Programmers Manual, p. 
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III. <sexp> : i" <atom>* <s#xp> ; j" <*?*:o^> 

iv. <sexp> ::* (C.UOTC <WxpressIon>?; 
<sexp> ::» <S-expressfon> 

Definitions such as Ml, iv> v, and v! arc disjunctive/ I»e* £i 
<sexp> Is either an <ato*i> or (QUOTE <S-exoress; on>)/ etc* 

v. <s«xp> : := <non) 1 st>; <sexp> : t» <nonl Ist> 

vl. <sexp> ::■ <ltst>; <sexp> v ::* <!l?t>, 

The first member cannot be *, **, *, Ql'OTE/ $SET, $*, 

S*#, or a <number> C-1C*) 

vU . <var> ::* <^orn>; <var> ;»=■ < r ora> v 

vlll* <form> ;;* (* <S-express'oi>); 

<form> v ;;» the value of (£VAL <S-express!on> A), 
where A ts an allst and »s one of the Inputs to the 
matching process (-li-> 

fx. <form> : ;= ( = <fn> <var> Cvar> ,,+ <var>); 

<for<n> v ::« the value of (APPLY <fn> (Cv^r> v 

<var>* ... <vsr> v ) A), where a tariff! ad APPIY ts used 
so that If <fr,> is an FEXPR or FSUBR the desired 
operation Is stt!l performed* 



****£:?********* *»£****** 



(-10-; We have already Indicated on page 12 that the <ep> ($ F 
$) is a <pattern>, Iv seens to Imply that (5 F S) Is also an 
<sexp>. The actual interpretation taken by the translator, 
PATT RAN, depends on the setclng of the QUOTE mode, (see 2,3). 
(The ':op level <pattern> / l*?, the input to t>c nrtcb, Is always 
treated a? a <pattcm> / regardless of the netting o* QUOTE.) 1f 
QUOTE Is *T*, both (s F S) and/ for axaaple, (A (P C) E), w-ll 
be treated as S-express'onS/ l.e* <sexp>'r.. If QUOTE ts Ml, 
both are treated as <panerrc> a s* Thu<; Iv fa correct provided 
QUOTE Is *T*. If QUOTE !s NIL, xxx applies. Note that 

regardless of the setting of QUOTE, (QUOTE (A (8 C) 1 £)> Is 
always an <sexp>, and (S* QUOTE (S F $)>) (see xxx? > Is always a 
<pattern>. 

C-11-) The match Is performed by a funcSlon MATCH1 V of three 
arguments, WS PATT A (see ssctlon 2.5). The value of MATCK1 .is 
NIL If WS does not mate!* PATT/ and is ths parsing of WS with 
respect to PATT If ths Tatch s*jccc*>ds. 



PAGE US 

x, <var> :;» <mark>, <var> v ::* <mark> v 

x* • <mark> : i" <number>; 

<mark> v :;* stme as (/T <nunfcer>) - see xlv 

xtK <mark> ;;* (<:number> <nrark:> ..«<n3rkl>); 

<mark> : :- sane as C/T <nurober> <markl> ., . 
<msrkl>) - see xlv. 

xl II • <Tiarkl> ::= <nuTiber> | <v&ri} 

<marki> v : s« <number> | <var> v , and must be a 
<numbe-> or else sn error occurs. 

xlv. <mark> v ::= *J/T <narkl> <rrarki> ... <markl>); 
<nark> :;* see the consents following xvi i 

xv. <^ark> ::» C/C <narkl> <markl> ... <markl>); 
<mark> ::■ -;ee the comments following xv!l 

xv! . <mark> :;* C/U <markl> <narkl> ... <Tiarkl>); 
<mark> v ::= see the comments foUov/ing xv! 1 

xvll. <match> ;;» ($MATCH <1lst> <llst> ... <Ust>>; 

A <match> *s the !nternat representation of an object which has 
been matched by a <pattern>. The first <Ms?> Is the internal 
representation of the objec:, I.e. <ep> v for the <pattern>, the 
rest of the <1tst>'s are thi* parsing, each <l:st> being an <ep> v . 
Thus If WS Is (A B C 0> / PATT <$ 3 $>, the <natch> Is CSMATCH (<A 
8 C 0)) (A) (5) (C D)> corresponding to. the* parsing £A] [3] tC 
OK If WS Is (A (3 C) D C3 E F) G) PATT CS <$ F $) $), <match> 
Is (S HATCH <<A (B C) C3 E F) G>) CA (3 C; 0) (SMATCH (<B E F)> 
(B E) (F) NIL) <G)K 

The evaluation of a <mark> :s \/ery similar for the three cases, 
xlv, xv, and xvl, listed above. The only difference lies in the 
starting point of the evsH'.itfon process. For /T the too level 
<match> Is used/ i.e. th* one being assenbled by MATCHi. For /C 
the current level <natch> 1 1; used. This will be the sane as /T 

If the Onark> In question la at the top level, I.e. is not inside 
of a <pattern>. For /y, the <natch> used Is the one n levels up 
fron the current level, where n is Onarkl> v , and <merkl> Is the 
first <markl> In <mark>. (If n Is too large, for exanple If 
<match> Is already at the top level, an error occurs.) 

Once the correct <match> Is locatei, the evaluation process Ts 
the sa^e for all <mark>*s* HARKVAL (the evaluation' function) 
successively evaluates each <markl>, and If the resulting number* 
n is positive, takes the <l!st> correspond? ng to the nth <ep> of 
the <natch> being used, and if negative, the <llst> corresponding 
to the nth <ep> from the end of the <match> being used. This 

<Hst> must be a <*iatch> and is then used as <niatch> for the next 
<rnnrkl>. Wh**n th^ 1acr ^mar^1> !c awainaf^H thA a<\? mr nnoH t n<* 



PAGE ifi 

<op> v Is found, and tM s Is the value of the <r*?ark>. If a <1ist> 
Is encountered before this which Is not a '!match>, or If n Is too 
large/ an error occurs. 

Since this process Is a little difficult to view abstractly, we 
Induce here several examples illustrating facets of the above 
deicrl ptlon. Although we us? numbers throughout the examples, 
remember that a <markl> can also be a <forn>, i.e. the result of 
a computation. 

Suppose MS Is IA B C (D E Ft G H (I J KL CM N CO P Q)))) and 

PATT Is (5 SI CS1 S F) $ ($1 S 52 (S ($1 P <X) ) ) ), where 

C< is sole <iiark>. At the t'me c< Is cvaUated, the top level 
<roatch> Is: 

(*MATCH CCA B C (0 E F) C- H Cl J K L CM N CO P Q) ) ) ) ) 
CA B) 

CO 

C3MATCH C(0 E F)) <D) CE> <F)) 

CG K) 

CSMATCH {(NKKKMOPW))) 
(!) 
CJ> 

a w 

CSMATCH (CM N CO P Q):> 
CM S) 

CSMATCH CCO P Q)) 
CO) 
CP ))))> 

For C< the value of c^ i s 

C/T 2), or just 2 CO 

C/T -3), or just -5 CC) - same as above 

t/T 3) CCD E F)) 

(/T 3 X), or (3 1) (0) 

C/T 2 i) ERROR 

C/T 6) ERROR 

C/T -2 2) (£> 

C/T -2 -1) CF) 

C/T 5 2) (J) 

C/T 5 4 2 2) (P) 

C/U 1 -I) CM N) 

C/U 1) (CM .V CO P Q>) 

C/'J 3 1) CA .?) 

C/U 3) (CA 8 C CD E F) G H (I J K I CM N CO P 0,))))) 

C/U 3 -1) (G H) 

C/U 4) ERROR 

C/C 1) CO) 

C/C -I) (P) 

C/C) CCO P Q)) 



• 
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XVl 1 1 • <ep> ::• <varp>; <ep> v ::» <varp> v 

Th's hi the first <ep> we ha*e defined so fjr. 

xlx. <varp> ::» <sexp>; same as (» <sexp>) 

xx. <varp> ::= <form>; sane as <* <for-n>) 

xxl. <varp> ::» <mark>; sane as <** <-nark>! 

xxl I . <varp> :-.= t* <var>); <van>> v ::■ (<var> v ) 

Here <varp> matches a segment consisting of the single 1 ten <var> v ; 
hence <varp> ■ (<var> v ), 

xxfM. <varp> ::» (*• <var>); <v.irp> v :;« <var> v 

Here It matches a segment of WS equal to <*<ar> v . Thus <var> v 

must be a list/ or else an error occurs. 

xxlv. <ep> ::* <djl>; <ep> v :*» <dol> V 

xxv, <doI> :;*.$; <do1> v n- <11st> 

Thus <tfol> matches any segment, 

xxvl. <ep> ::- <dotn>; <ep> V ::■ <doTn> v 

xxvtl. <doln> :;• 5n/ n a <ny-iber>* 

<doln>" ::* <Iist> of lengi.h n 

xxvl II . <doln> ::■ ($N <var>); 

<do1n> v ::» <1Ist> of length <var> v , 

if <var> Is not a number, an error occurs, 

xxlx, <ep> ?:» <p*3ttern>; <ep> v : * <pattern> v 

xxx, <pattern> :;» (<ep> <ep> .<. <ep>); 

<pattern> :;« sa*ie as ($* (ClUOTE (<ep> <ep> „. 
<ep>)3) C-X2-) 



****** *********** * ***** *********** 

■ 
(12) This assu-nes QUOTE is NIL/ otherwise this Is an <sexp> and*' 
falls under vl (see also footnote 10), If QUOTE is +T*, use ($* 
(<ep> <ep> •*.))). (Note tha*: ($* C<ep> <ep> ... <ep>>) Is not 
correct if QUOTE Is NIL as (<ep> <ep> ... <ep>) wt 11 then be a 
<&9-U£Cfl> and S» expects a £xa££. However/ ($* (QUOTE ( <ep> <ep> 
* , * <ep>)) ) is always correct. 
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xxxl. <pattern> : i m ($* <var»; 

<pat*orn> ::« (<ltst», where <11st> matches 
(the translation of) <vor> v , in the sense defined he;-n 
(-13-) 

In other words, <pattern> matches a segment consisting of a 
Slnjdfi l£&?, which Is a list. Although the value of <pattern> as 
an <ep> l5~ (<U.s t>), what Is appended to the <match> being 
constructed' by "MAT" CHI Is actually ($MATCp <<l?s t>) sesmentl 

segment2 ...), or In oth«r words, the parsing of <llst> with 
respect to <var> ,* 

xxxll. <pattern> v:» ($** <var>); 

<pattern> : :- <list>, where <llst> matches the 
(translation of) <var> etc, as above 

Mere <l!st> Is a segment of VJ$, not a single Iten, Asal n what Is 
appended to <match> Is (5 MATCH <1'_s_t> <segl> <sez2>...>. Thus, 

C$ ($** (<epl> ... <eon>?) $> matches the semis things as (S <ep»> 
... <epn> $), except that the $** has only one <e?> 1/ / (although 
It contains an <ep> for each of the n <ep>'s>, and the 

S-express!on (<epi> ... <epn>) may be replaced by a <form> or a 
<mark>. 

Again we Include some examp'es. 



*ft#**.««|******* *********** **" ****** 



(-13-) The list structure that is <var> wl.ll be altered by the 
translation process (see section 2.3). This means that If a 
quoted S-express'on is used. It will be translated only one*. 
'However, It also means that If It is not desirable to have the 
structure clobbered, one should use a <for:r> with the function 
COPY. 
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Suppose WS Is (A S C ($1 S </C 1) ) FOO D X A (3 C B) (B C 3 

A) X Y), PATT Is (S SI Eflfi $ (S* C- COPY (» CAR 2))) $>. When 
<pattern> Is entered, the %'X matches (<SX S (/C X))3, I.e. the 
value of <match> Is ($ MATCH ((A B C ($1 5 < /C X)) FOO ... )) {A B 
C) ((SI S (/C 1))) (FOO) ()>. 

The value of (- CAR 2) Is therefore (SI $ </C 1)) and thts Is 
(copied and) translated and used as a pattern to match against 
the single Item which Is next In WS, namely D. The natch falls 
(Immediately because Is not a list) so t?e second S extends Its 
segment to Include (it now matches (03). (■ CAR 2) Is 
reevaluated, translated (if we were not concerned about 
preserving the structure C$:L 1 (/C 1)), we could omit the CO^Y 
and then only one translation would be needed) end reapplied, 
this time to the I tern X. The rratch falls 3;;aln. Ultimately it 

succeeds matching with (BCD B), and the final value of <match> 
Is U.VATCH ((A B C ...)) (A 3 C) (($1 S </C 1))> (FOO) (D X A> 
{$ MATCH <(B C B>) (B) (C ')) (8)) ((B C D B A) X Y) ). Note 

the <match> corresponding to <pattern>. 

If WS had been (ABC (SI S (JS_CAB_U> FOO ...), then <pattern> 

would have matched with (9 I D B A), and <rr:atch> would have been 

(SMATCH ((A B C ...)) CA_B C) ((SX S (■ CAfc 1))) (FOO) (0 X A (3 

C B>> (SMATCH ((B C 8 A)) (S) (C D B; SM> <X Y) ). 

The $** <ep>, as Illustrated by the next examples, Is used to 
match a s e^menj of WS. Suppose MS Is as above (with (/C 1)) but 
PATT Is (S SX FOO S i%±± (■ COPY (• CAR 2)») S). The value of 
<matcr> here would be (SMATCH ((A 3 C ...).<) (A 3 C) <(S1 S f/C 
X))) (FOO) (0) (SMATCH (X A (3 C B) ( S C B A) X) (X) (A (3 

COB) (B C 3 A)) (X)) (Y)). Nott: that the value of 

<pattcrn> is a segment of WS, [JLA (SCO ID (B C D 3 A) XJ which 
matches (.§A $ UC_1)). If we change WS as t-efore to be (A B C (SX 
$ (- CAR X)) ...),"then <match> is (SMATCH ((A 5 C ...)) (A3 C) 
((SX S (- CAR 1)>) (F00> (SMATCH (0 X A) CD) CX) (AJ ) C(B C D 

B) (3 C D 3 A) X Y)). 

The "Abort Predicate," "Fast S," and "Failure Predicate" 
extensions of <dol> described below may all be used Inside of a 
<pattern>, either of the $« or $*" variety. In the $• case, they 
act exactly as they do In PATT, which Is itself a S* <pattern>. 
In the $** case, some care must be exercised Involving <mark>*s 
and the "Failure Predicate," and the "Fast S" will not operate 
across the interface between the S** <ep> end the rest of the 
<ep>'s. We will discuss this In detail In the description of the 
operation of PATTERN and PATTERNX in section 2.S. 



xxxlll. <npred> ::= (<fn>)|(<fn> <var> ... <var>); 

<nured> Y v ::» the value of (APPLY <fn> (<ep> 
<var> ... <vsr> ) A), where <ep> v Is the value of the 
se^ent matched by the <ep> w" th which <npred> fs 
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associated, and a modified APPLY is used so that FEXPR3 
and FSCSRS will wo-d. {•!%•) 

xxxlv. <ep> :;* <v,irf>; <ep>* ::» <varf> v 

xxxv. <vp.rf> ;:» <varp> / <npred>; 

<varf> v ;:» ;varp> v provided <npred> v Is not NIL. 

In other words, the segment matched by <varf> is Identical to 
that matched by <varp> with the added constraint that the value 
of <fn> given <var P > v as its first argument, and Che evaluation 
of the rest of its (optional* argurents, Is not Nil., 

Example: If X Is C and PATT IS ($ $5 (- X) / ((LAK9DA (Y Z> (NOT 
(MEMBER (CAR Y) Z)>) 2) $), the result of matching with WS (C A 
BCDCEFGCHDIs ($ MATCH ((C A ...)) (C A 8 C C) (E F 0) 
CO (H I)). Note that the va^ue of the argument Y is <ep> v , and 
therefore one nust take CAR of It for use with MEMBER, 

xxxvl. <ep> i:» <dolnf>j <ep> v ::= <dolnf> v 

xxxv! I, <dolnf> .;:" <doln> / <npred>; 

<doln?> v :::» <doln> v with th* added constrain? 
that <doln> satisfy <nprcd> as above. 

Example: (S S3 S $3 / ((LAMBDA (X Y) (EQUAL (REVERSE X) Y)) 2) S) 
will match with (ABCDEFDCBX) producing UMATCH ((A 8 
...))) (A) (B C D) (E F) (D C: B) (X)). 

xxxvlll. <ep> ::• <do!f>; <ep> v ::" <dolf> v 

xxxlx. <dolf> ::■ <do'> I <npred>; 

<dolf> v :; = <doi> v provided <np,-ed> y Is not MIL 
or (NIL). 

Example: (S $1 S / ((LAMBDA (X) (GSEATERP (LENCTM X> 5))) ?. } $) 
will match with (A B C D A D S C 8 0) to produce ($MATCH ((A B 
...)) (A) CD) (C A D 3 0) (S? (?)}. 



(-11*-) <npred> may be ecuaj to NIL. In this case, it is the same 
as though it always had the value *T*. Thus 51 / Nit is the same 
as $1 / ((LAMBDA (X) T>), ?nd the same as .Just $1. 
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The Abort Predicate 



The <dolf> Is a general Izat on of <dol> cnalasojs to that of 
<dolnf> over <dol"> and <varf> over <varp>. In other word:*, 

<dolf> acts tike <dol> with side constraints In what It matches. 
However, here the slml lari ty ends, 

A <varf> or <dolnf> can determine Immediately whether or not It 
will match, because S ts <op> v Is determined within itself* A 

<dolf> however con match more than one segment, and Its <ep> v Is 
really determined by the reculrements of the other <ep>*s In the 
<pattern>. This means that the <dolf> has the unique property of 
being able to try other <ep;~'s even after finding an acceptable 
match, it also implies that a considerable amount of the effort 
spent on a natch m3y be Involved In the <dclf> search, and that 
It Is appropriate to find way3 to streemiire it and make It more 
efficient* 



Consider the cas<* where PATV Is (5 SI J / ((LAMBDA (X) (LESSP 
(LENGTH X) 5))) 2 S) and WS i s (A 3 C D E F G A H I K I M 
.,.). The <dol> Initially' matches [J and the SI EA3 f The <dolf> 
Initially matches [J but [B; does not equal (A3 • The <dolf> then 
matches £8]/ but EC] does not equal (A], Finally, the <do!f> 
matches [BCD EJ, but [r] <!oes not equal [AI . Next the <dolf> 
tries to match with [S C 3 E F], Since the length of this segment 
is not less than five/ it will not match, so the <dolf> tries to 
match with [B C E F G] , Aj;ain the length of this segment is not 
loss than five, so It does not match. Similarly, the <dolf> will 
try to match with each segment until it exhausts the list WS. 
Only then will It determine that It canrot match and return 
control to the first <dol>. This will then match with [A] and the 
<do!n> with [B3. The <dolf> search will be repeated. Finally, a 
match occurs with value <$ MATCH ((A S C ,,. ))) (A 3 C) (0) (E f 
G A) (D) (H I J ,,.)), This Is of course correct and what was 
intended, but it could have been *ound with a more efficient 
handling of the <dolf> search. 

The first extension of <dolt : > Is designed to solve this problem* 
It Is called the "abort" feature, and allows the user to specify 
under what conditions a <c-olf> search can be terminated. If the 
value of <npred> applied to the appropriate Inputs Is ever NIL, 
the <dolf> fails to match, and no further search occurs. If the 
value Is (NIL), the <dolf> does not match this segment, but the 
search conti nues as before* In the example zl ven above, the 
<dolf> would not have attempted any further matches once It tried 
the segment IB C D E F] since the value of <nprc£> was then NIL.,- 
If we wanted the segment matched by <dolf> to have a length 
between 5 and iO, we could use (LAM3DA (X> (COND (UESSP (LENGTH 
X) 5) (LIST NIL)) ((GREATER* (LENGTH X) 10; NIL) (T T)J) t 
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xU <rfolf> ::= $ // <n;>re£>} 



*V 



<doif> ;:= sa^e as xxx*x 



The Fast 5 



The second extension of the <dolf> allows a faster and more 
efficient search in certain instances. Consider the case where 
PATT is (S SIS / ULAMSDA (X) (LIST (GREATER? ClENGTH X) 10)))) 
2 S>. The <npred> associated with the <dol"> will be applied to 
the segment that the <do^f> Is matching each t'^e 3 match Is 
attempted. Then control will be passed to :he <v3rp> 2. If this 
fal is, the <do3f > extends I ts segment and reapp! * es the 
predicate, it would be desirable If the predicate were pv.y 
applie d once the <y_?rjj> 2 found an acceptable :>?"?nt, !n f*ct, 
it wo^Hd be nice if it wore not necessary ' to" veave <dolf> and 
reenter the <v$rp> for each attempted match/ and we couJd 
essentially evaluate the <vsrp> and run along V/S tookinx for 
sometMng matching It and only then apply the predicates* etc. 
This Is accomplished by meats of the "fast 11 feature. When a // 
£ppears with <do!f> and an vnpred>. If the neat <ep> Is a <varp>, 
<varf>, <do1n>, or <do!nf>, the <do!f> secrch Is handled In FAST 
mode* (-15-) 



********* 4*4* ************** 14** 

C-15-) If FAST Is set to *T* at run time/ ell <do>f> T s will be 
treated as though a //"were used. ""if FAST Is set to *T* at 
&C3£&ltLEifil* time/ all <dolf> f s will be treated as though a // 
were used regardless of whan Is the value of FAST at run time- 
This Is usually the desired mode o** operation except where It "s 
necessary to have sorcc <do1f ! >'s not operate In FAST mode* In th' s 
case^ £A$T should be NIL and these <dolf>'s written with a slns'e 



* * 
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In order to properly explain the effect of the 'AST mode, we must 
discuss the way In which a natch normally proceeds. As wo will 
ssc *n section 2.5, the translation of a pattern corresponds to a 
sequence of function calls, one for each <cp>. At the time It Is 
called, each <ep> function is given arguments rel at I ng to 1 ts 
particular operation, £•£• lor a <do!nf> the arguments are the 
<var> whose value will be the length of the segment/ and the 
predicate which this segment; must satisfy. In addition, each 
function Is supplied with three arguments: the current WS/ the 
current MATCH, and the current PATT. If the function determines 
that It matches a segment a*: the beginnlrg of WSj It passes 
control to the next <ep> function Indicating what WS it shou'd 
operate on, together with the new, modified MATCH, and PATT 
(which Is the old PATT ml nu<; the <ep> function which has jur;t 
operated)* If the function corresponding to the first <ep> do^s 
not match on Initial segment/ it returns a value to the last <ep> 
function indicating failure, 

For example. If WS is (A B C D) and PATT I s (S SI C $), the input 
to VARF the first time it Is entered Is (3 CD) for tf$, C$MATCH 
CCA 3 C 0>> NIL (A)) for MATCH, ((DOLF Nit- NIL NIL)) for the rest 
of PATT/ and three argument** relating to the needs of VA£F. These 
are (SEXP C), N!L, NIL (the first NIL Indicates the <var> 
represented by (SEXP C) Is i:o be treated M an item/ and the 
second Indicates there Is no predicate asscc' ated wfth It), Since 
(SEXP C) has the value C/ and C does ret metch B, the first thing 
In WS, VARF returns a va'ue that Indicates It did not succeed *n 
match! ng* 

The second time VARF is entered/ DOLF havirg extended Its <ep> , 
WS is CC 3>, MATCH is ($ MATCH C(A 3 C D)) <A) <B)), again ({DOLF 
NIL NIL NIL)). This time CSi:XP C) matches with the C at the 
beginning of the WS, so VA^r passes contrcl to the next <eo> 
giving It (0) as WS, (C$MATGH ((A S C D)) <A) (B) (O) as MATCH, 
and NIL for the rest of PAP", This <ep> i? the last <do1> and it 
matches the rest of WS/ namely [DJ. 

This procedure will be exam rod in greater detail when we explain 
the operation of each function In section 2,5. At this po'nt, 
however, It should be clear already th*t the COLF function 
assumes a special role. It *s the only <ep> which can resume 
operation once It has matched a segment entf passed control on to 
the next <ep>. In the example above, when VARF indicated It 
failed to the DOLNF/ which was the function entered Immediately 
before It, OOLNF then also failed. in other words, the match had 
determined that starting from (A 3 C 0), $X followed by C d^d not 
mach. Even though $1 did match, the entire match would have 
failed had these two <ep>'s not been proceeded by a S, or call to* 
DOLF. 

When COLF matches an acceptable segment, it passes control on to 
the next <ep> function. Should everything match from then on, the 
segment matched by DOLF at this point is the one corresponding to 
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reveres to the last $/ and it resumes try'ng to find «n 
£ccep':able segment/ exactly as though *t bed n<*ver matched 
beforn. 

Let u*- consider yet another example* Svpo?se WS n is CA S C B D 
C E) and PATT CS $1 $2 2 $K DOLF/ corresponding to the first $, 
wou'd be entered initially with WS (A B C B D C EK MATCH * 
C$ MATCH <CA B C 8 D C E))>, and PATT * (CDOLNF 1 NIL) CDOLSF 2 
NIL) {'VARF *T* (HARK /T 2) NIL) (DOLF NIL !J1L NIL?)* Note that 
PATT corresponds to the translation of the rest of t>.c pattern/ 
namely (Si $2 2 $K Since no predicates a*e associated with this 
DOL p / It matches the first acceptable segment/ namely the null 
segment/ and passes control to the next <e:>>/ a DOLNF^ with WS » 
(VARF *T* (MARK A S C D 3 D C E), (the sam* as It was before)/ 
PATT * CCOOLNF 2 fill) (VARF *T* etc* and MATCH • (SMATCH ((A 3 C 
S C E)3 MIL). 

The DOLNF matches with (A) and passes control to the next DCLN^ 
gfvtnc ItCBCBOCE) for WS/ ((VARF *T* etc.)) for PATT/ and 
(SMATCH ((A B C B C E)) NIL IAJJ for MATCH, This DOLMF also 
natchas, with (B CK and posses control to the VARF with WS (3 
C E)/ ((DOLF NIL NIL NIL)) for PATT/ and MATCH (SMATCH ((A B C B 
D C E)) NJL (A) (3 OK The 'VARF falls because the value of (MARK 
/T 2) !s (A)/ and (A) does ->ot match the beginning of (3 C £K 

At this oolnt/ control pass?s all the way back to the first DOLF. 
This COLF then matches with CA)/ and passe:; WS (5 C B 3 C E)/ 
MATCH (SMATCH ((A B C 3 C E) (A)) end PA":"T ((DOLNF 2 NIL) (VARF 
*T* ...)) onto the next DOLNF and the process continues, i-16-) 



*******#***#***#****** 
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The FAST node Ss designed to eliminate some of this process by 
decreasing the nunbor of function calls necessary to complete a 
natch, [f a OOLF Is entered ar\6 the next function call In PATT ;s 
to a DOLNF or VAR C , a fast DOLF does not merely natch up with the 
first acceptable segment anc pass control. It will not attempt to 
natch any segment unless the DOLNF or VARF is also going to be 
satisfied. In fact/ the OOLNF or VARF is never actually entered 
<and will rot be printed out if the TRACE Tiode Is turned on). 
What DOLF toes do is evaluate the <var> used by DOLNF or VAR*, 
and If there is a predicate, also evaluate the Inputs. This *s 
done just once. Then DOLF searches WS to find the first segment 
that will satisfy the DOLNF or VARF* When this segment Is found/ 
OOLF applies Its own predlcete, if any, to the segnent consisting 
Of aM of tfS up till the segment that matched the DOLNF or VARF. 
If the predicate yields NIL/ DOLF abandons search and reports 
failure/ as In the h abort 11 discussion above. If it yields (NIL), 
DOLF continues searching. Otherwise/ DOLF matches/ and so does 
VARF/OOLNF/ and control Is passed to the next Cep> after the 
DOLNF/VARF, 

In a previous example/ where PATT was ($ S3 S S3 / ((LAK9DA (X Y) 
(EQUAL (REVERSE X) Y)) 2) S>/ and WS was <A 3 C E F C S X), 
the sequence of function calls would be as follows: first OOLF 
would *>e entered and match with mi,, then dm,vf would match with 
(A B O* The second DOLF would match with ^[L/ and the secord 
DOLNF would fall. The second OOLF would natch with (D)/ the 
second DOL*\F would fall again (note that it had to reevaluate 
the value of the <mark> 2 which was an Input to its predicate).. 
The second DOLF would match with (0 E), the second DOLN'F would 
fall ajjain/ etc. FlnaMy, the second DOLF/ after putting In seven 
calls zo the second DOLNF with none of Cham succeeding, would 
fall. At this point the first OOLF would Tiatch with (A)/ the 
first DOLNF with (B C 0), and we would continue. 

If Instead the second DOLF were a fast DOLF, I.e. If It were $ // 
NIL/ or if FAST were *T*/ the sequence of *unctIon calls would 
now be as follows: the first DOL? would b* entered and match 
with N L/ then DOLNF would match with (A 8 C). The second DOLF 
would evaluate the <mark> 2 getting (A 3 C)/ and determine that 
It was looking for a segment of length i which satisfied a 
certain function of the two arguments consisting of this segment 
and (A S C). It would then rsr\ through WS a;id determine that no 
such segment existed/ $r\£ therefore fall The first DOLF would 
then natch with (A)/ the D0L*1F wf th (S C D). The second DOLF 

would evaluate the <nark> 2, getting (8 C D), determ! ne It was 
looking for a segment of length 3 such that this sesment and (B C 
D) satisfied a certain predicate/ and would find (0 C 3J. Since 
this DOLF matches any segment (there being no predicate), it 
would natch with (E F), and natch the DOLNF with (D C 3), th4' 
segment OOLF had found for it, and pass control to the next <ep>, 
which Is the last DOLF, 
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The FAST rode, as with the case of the "abart* 1 feature, does rot 
affec: the ultimate value of the matching process, C-17-) ft 
mere!/ affects the way In which the search for this parsing Is 
perfo*med. Because the search Is performed differently in FflSi 
rrode, however, a few words of caution are necessary. First/ slrce 
the OOLNf or VARF In Question Is not actual y entered, nor is t*e 
segment matched by OOLF actually appended to the <match> until 
both of then are satisfied, negative <*iarks> must be adjusted 
accordingly* Thus (S $1 S '2 S) wM1 not operate in FAST mode 
with the Intended meaning. What shoutd be jsed lis ($ Si $ zX S> 
because when the <mark> Is evaluated. It will be done so inside 
of th<3 OOLF, which will then have a parsing corresponding only to 
the ffrst <do1f> and the <do!nf>* Similarly, something like (S 
<$N (» LENGTH V) $) will not work In FAST mode because the I 
refer:; to the first OOLF, which does not have an <ep> In the 
parsing until after the <doinf> has matched* In both c^ses an 
error will occur In MARKVAL statins that the <n*rk> In question 
Is too large* The user can avoid this by Sosrlnj; In mind what 
actually Is sotng on when the <dolf> Is running In FAST mode* 



ft*************************** 

C-17-) Strictly speaking, this Is not true. It la possible to 
write FLIP statements so that the "abort" feature will cause a 
correct parsing _Qfl£ to be found, even where one exists. For 
exanpie If we assure EVEUP to be a predicate wfth the obvious 
definition, then If WS is (A 8 C E F G), and PATT ($ / ((LAMFOA 
CX) C2VENP <L6«GTH X)))) E $), there will ie no <rnatch> because 
when Cdolf> Hatches with tfil , Its length Is not even* However, 
note that the parsing EA S C 03 tE) [F G] Is correct (since the 
lenstT of CA 8 C Dl Is ever)* Note th3t if this was run with a 
FAST :>, It would work, because the OOLF would not apply Its 
predl;ate until It fountf the E, at which time It woujd be 
satis-led. However, we can also find cases tn which a particular 
FLIP - ule will not operate in FAST mode, as It Is written, even 
thoush i t wl 1 1 In non-fast mode (see warnings above)* All this 
means Is that the user roust occasionally be a little circumspect 
when using these features* 
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One special convention Is a/alleble, however, which does allow a 
<dolnf> or <varf> to rsfer :o the value of the <dolf> Immediately 
proceeding It even when that <do!f> is running in FAST mode* This 
Is dene by makl ng the fXt*S input to its predicate the <mark> 0, 
which is then checked for specially by D0Li : . For example, ($ f^ 
/ {(LAMBDA (X Y) (SUBSET X (CAR Y>)) 0) S) will match with (ABC 
D C B E A D X Y); to produce [A B C B KJ tD A D] tX YK 

The actual value of the <reark> Is list o' r <doU>" ! (hence the 
use oi' CAR In the example above)/ because we wish to have <doTf> 
evaluate the Inputs to the predicate on!y once, and yet stMl 
have rhe <nork> indicate the Tatest segment matched by the $. 
This means that the <mark> must be a pointer to a list structure 
which the OOLF function can change. Since :hls list structure Is 
Initial ly NIL, we must list it In order to provTde a structure 
which OOLF esn then modify* (We cannot actually modify MIL 
without doing dreadful things to LISP,) 



The Jja.lJ.u/.e Predica te 

The third extension of the <do!f> Involves the resuming of search 

once t;he <dolf> has matched and passed control to the next <ep>. 

Occasionally It is necessary to base th<* decision to resume 

search on Information relating to why the subsequent natch 
failed. This Is done by meais of the "failure" predicate. 

xlt, <dolf> ::- $ / <npred> / <n*>red>; 
<dolf> y : :■" same as xxxsx 

xJII. <do'f> ::*$// <npred> / <npred>; 
<do!f> v ::= sane as xxxtx 



Once the <dolf> has passed control onto thv* next <e?> (or the one 
following that in the esse of a fast <dolf>), and control reverts 
to it, the failure predicate, which Is the second <npred> In xll 
and xlil above Is appl I ed, - •*! th Its arguments evaluated agaTnst 
the results of the en_t j_r e match. Any <ep> :hat did not natch Is 
assigned an <ep> v consis'tlns of the single atom "FAILED". Other 
<ep>'s that did match have vaiues as defined above, <dolf> 
evaluates these arguments and gives them to the "fa* lure" <norod> 
(In this case, the segment matched by the <do*tf> itself Is not 
automatically the first argument of the <npred> as above - you 
must ask for It). If the value of the <npred> Is NIL, the <do'f> 
does not continue searching but oasses control back up the line 
(perhaps to another <do'f>). Otherwise, it continues searching. 
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Examp'e: find an Item In a list that is related four times. If 
PATT Is fS $1 2 $ 2 $ 2 $) and WS Is (A 3 C A D € A S C 8 G C), 
then when <doln*> matches A, the first <mark> will also match es 
will the second <mark>, because A Is repealed three times, The 

third <mark> v/M ? not natch. When control revert? to the th! *d 
<do!fJ/ however/ It will go on locking for an A, Since the fourth 
A was never found/ th^s <do!f> wM) not find another third 4, 
Ultimately It falls and passes contro' hacU to the second <dolf>» 
This <dolf> will continue s^arcMrg for a second A/ find on^ 
namely whet had been the third A/ and pass control on to the next 
<dolf> to look for More A's.. etc* 

If the pattern used was ($31 $ / ViL / (HO H) 2 $ / MIL / (tfO 
63 2 5 / NIL / CNO 8) 2 $), (-IS-; the <do»f>*s would 

continue search>n^ only until they found a maSeh for the <mar*> 
Immediately following them* When the fourth A was not found aid 
the fourth <do!f> failed/ the parsing was IJ (A3 [8 C3 [A3 ID E3 
[A3 (EC SCDC), Contro: passes to Che third <dolf> where tne 
<mark> 6 Is evaluated against (SNATCH ((A KCADEABC8 C 3 
C)> NIL CA) CB C) (A> CO E) (A) (B C B C D C) FAILED FAILED). 
C*19*) Since the 6th <ep> id match/ Its <op> being (A), (NO 6) 
is NIL and the <dolf> fails, Similarly for the third and second 
<dolf>. 



*■»**** *^ + *+T>#***ft + *#**+*^**V* 



(-1S-) NO Is a function which Is true only If Its argument d'd 
not match/ i.e* It Is (EQ X (aL'OTE FAILED)), YES Is not NO, 

(-19-) Actually/ what Is returned fron the failure Is ((SMATCH 
(CA E C ,.,)) N!L (A) (3 C) (A) (D E) (A) (3 C B C D C))>. The 
extra parentheses Indicate that a failure ta$ occurred. When DOLF 
evaluates the failure predicate, it sets a flag so that MA3KVAL 
returns FASLED where It previous 1 y wou!d have given an error. 
Note t^at negative marks will count backwards from wherever the 
<match> ended/ and therefore $re not really meaningful* 



* ' 
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If fast <dolf>'$ we'e used, we could also *rite <$ $1 $ / NIL / 
(KILL) 2 $ / NIL / (KILL) 2 S / NIL / (KILL) 2 $), vt>.cre the 

value of NU.L is NIL, in this case, the <dolf> dees not give up 
control until It finds a match fo«- the <mark> fo'lowlng It. The 
(KILL) Insures that It will not continue Ipoklng If It gives up 
control and then regains It. 

Although tils example is extremely slnple, ani cculd be done by 
means of a suitably designed "abort" pred^ate instead. It gives 
the general flavor of the failure predlcat?. The longest common 
substring problem In the next section uses the "failure" 
predicate In a more Interesting fashion. 



xllll. <do!f> ::» S / / <npred:>; same as $ / NIL / 
<npred> 

xllv. <dolf> ::= :; // / <npred:-; same as $ // NIL / 
<npred> 



Before leaving t:ie failure sredleate, we should emphasize two 
features. First the fa'lu-e predicate Is only applied when 
control reverts to the <dol -> after a fat U re. If the <dolf> is 
not in fast mode, this will be afte_r e_a_c.h i t temp ted -a&tcjj by the 
ngxt < ep> . If the <do!f> is In fast node this will be only" aftVr 
the next <ep> has matched, and some subsequent <ep> has failed. 
Secondly, If the f a : lure predicate Is applied and does not yield 
NIL, the match continues exactly as thoush nothing had happened. 
If in fast mode, this means the <dolf> continues to look for a 
match for the next <ep> if It Is a <varf> cr a <do!nf>, applying 
Its "abort" predicate only when It finds a match, etc. (It first 
reevaluates the arguments o' T the predicates, and the <varf>'s 
Involved because the allst nay have been changed.) If not "n 

fast mode it extends It segment, applies the "abort" predicate, 
if any, and goes on. 



xlv. <$set> ::= (SSET <atom> <var>> 

<Sset> Is not an <ep> In the strictest sense. It does not match 
anything nor does it have a value. Whan using <mark>'s pretend 
the <Sset> Is not In the pattern at all. The purpose of Sset Is 
to altar the alist, A. It binds (or rebtnds if already bound) 
the variable <atom> Eg the value o c <var>, it uses the functl r. 
SSET1 to perform this binding. SSET and SSET1 are described In 
section 2,5 
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<do11> Is a device for allowing the user to assume control of tie 
match* The value of the natch Is the value of <npred> given as 
Its first three arguments WS, PATT, and MATCH, and the evaluation 
of the rest of Its arguments (if any) against the current MATCH* 

The very existence of <do!1> guarantees that FLIP Is universal, 
because It means we can peforrn arbitrary LISP computations. For 
example/ If FN is a LISP function of two arguments/ X and Y, th«n 
($*$ / ((LAMBDA ^A 3 C) (FN X V))) ) Is a FLIP natch statement 
having the value of (FS X Yi, assuming that X end Y are bound Co 
their correct values on FLlP f s alist. 

This also mean;; that the presence of <<SoM> precludes the 
necessity of ever writing functions such as DQLF, VA3F, PATTERN/ 
etc*/ since one could write each of these Instead by means of a 
<do!1> function! 

For exanple, one can write Instead of ($ $? A $ $* S $) 

($ S*$ / ((LAM33A (HS PATl' HATCH) (COND 
((LESSP (LENGTH WS) 3) (LIST-MATCH))) 
(T (MATCH2 (CDDDft WS) f'ATT (APPEND MATCH (LIST 

(CAR WS) CCADR WS) (CAODR WS))))) ))) 
AS $*$ / CCLAM80A <WS PATT MATCH) (COMD 

((«JLL WS) (LIST MATCH)) 

(T (MATCH? (CDR WS) PATT (APPEND MATCH (LIST (CAR WS))))) )?) 
B 5> (-20-) 



The us*r, observing that operations such as $3, SI etc./ oftfrn 
arose In practice/ might wish to define a function, call it DOLNF 
for want of a better name, which would take n as an Input arui 
perform the same task as the <doU>'s above. He would then be 
able to wri te 

C$ $*$ / (DOLNF (QUOTE J)) A $ $*$ / fDOL^F (QUOTE 1)) B $) 



rtttti 



(-20-) MATCH2 is the naln routing function for MATCH, -It will be 
discussed in detail in section 2.5. Its effect Is to call the* 
next <ep>, which isobtalned from PATT/ giving It WS/ (CDR PATT), 
and MATCH as arguments. It checks to see when PATT is finished, 
or If WS has been exhausted* 
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To avoid repeating the $*S notation, he might: even wish to 
Introduce a new translating convention vhereby ($N 3) meent 
(00LN1* (QUOTE 3)), etc./ and so be able to simply write 

(<i (SN 3) A $ <$N 1) 8 S) 

This !s exactly the way the $N pattern, and ether elementary 
patterns discussed above, were developed, and there is no reason 
why a prospective user could not similarly define nev; operations, 
should they prove desirable, or even modi -y the exist-ng ones 
supplied v>!th the Ft I P package. 

The <coll> Is intended to serve In those cases too Infrequent to 
justify writing an entirely new <cp> function. All that Is 

necessary is to observe the few conventions rel at ! ng to 
comnuri cation between <ep> functions (unless the <doll> Is to 
entirely assu-ne control for the rest of the match. In which case 
no other <ep> functions will be called.) In rrvost Instances, much 
of the labor can be performed by existing functions in the FLIP 
package, such as MATCH2, MA"CH3, VARVAL, MARKVAL, NEXT, FIRSTS, 
LASTN, etc. All the user then need do Is assemble the parts. 
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2*2 Comparison of Flip and LISP 

2*2,1 A Simple Exempte 

Programming languages can be compared In many ways, but the 
cholc-* of one language over another for a particular task usually 
resolves Itself Into a subjective deepen which depends on the 
natura of the problem, and en space and tine reoutremsnts for the 
program* It ts impossible to give ^T\ absoljte evaluation of any 
language that win hold for all, or even a wide class of 
problems* 

This Is a*so true In the case of FLIP, However, since FLf? Is 
embedded fn LISP and Is Intended to be used by LISP users, we 
will attempt to strike some comparisons be:wecn the two, 

FLIP Is certainly slower than LISP* Al :hough their relative 
speed*, vary greatly dependMg on the nature of the problem. It Is 
safe to say that a LISP compiled function :s anywhere from two to 
five times as fast as a FLI 3 function to perform the sane task* 
(FLIP Is usually faster than a LISP program that Is run 
i nterpretlvely, but again tils depends on the problem and the 
particular function used*) This Is obvious; because FLIP itself 
is a collection of compiled LISP" functions, and thorofore cannot 
be faster than a special purpose LIS? compiled function. When 
predicates 3r^ used, FLIP runs slower than LISP compi I *d 
functions because it must use the LISP interpreter to evaluate 
the predi cates* 

This, of course. Is not very discouraging. A L!SP program runs 
slower than written In LAP ! an assembly program for LISP), and 
MAD programs are slower than FAP programs, it Is In fact very 
heartening that the difference In running times !s so small. Even 
If It *ere greater, there would still be seme justification for 
developing a language such <i$ FLIP* One usually chooses a "hlsh 
level" language not for i t;- speed, but because of increes^d 
understand! bi H ty and ease of wrl ting* This pof nt Is we* ■ 1 
exemplified by a LISP function to perform the (S S3 A S SI B 5 » 
1 5 4 2 C 7) transformation discussed In the Introduction. 



TH^cTW 



CJV^ " 



(LlSPEXA;: n LE 

( LAMBDA (X) CPROG {FIRSTS S3 SECONDS) 
CCOIJD 

((LF.SSP (LF/ICTH X) 6) (RETURN NIL))) 

ti (conn 

((HULL (CnOHrl X)) ClSTUWI MID) 

< (EQUAL (CAODPR X) £ lUCTE A)) (SO T2))) 
(SETQ FIRSTS (CO:!S (CA3 X) FIRSTS)) 
(SETQ X (C3!» X>) 
(GO Tl) 
T2 (SETtJ S3 (LIST 

(CAR X) 

CCADR X) 

(CADOR X))) 

(SET'i x (cnrooR x)) 

T3 (COW 

((HULL (CD* X)) CnETJRII MID) 
(CE A .LAL (CAHR X) ( 1U )TE 0)) (GO TU ) ) 
(SETO. SECOND? (CO::S (CAT X) SECO-IDS)) 
(SET* X <C!*l X)> 
(GO T3) 
m (RETURII (XO:!C (REVERSE FUSTS) (CO IS (CAR X) ( 

MCOI1C (REVERSE SECOilD$) CICOHC S3 (CO.JS (QUOTE C) (Cm X)) 

nil. 



A LISP pronra"! to perform the transformation: 
$*S3+A*$*$l + n » + $=l + 5 + l**2 + C+7 

(Sec text, pase 32) 
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corresponding FLIP statenen';, any more than that the conpn ad 
version of LISPEXAMPLE Is as understandably as the S-express?on 
definition jlven above. This Is tho point of using LISP, or FLIP: 
the standardization of frequent 1 y used operations/ and the 
adootlon of a meaningful notation for them. 

It Is Instructive to note etactly where FLIP loses the race to 
LISP In the example above. In the orea between Tl and 7?, 
LISPEXAMPLE Is looking for Che ato™ A. The FLIP rule does this by 
repeated attempts to match the fourth e?emi!nt In WS with A, jus: 
as LISPSXAMPLE does, Howevsr, It Is done by calling the function 
DQLNF followed by VARF, I ns read of by (EQUAL CCAODOR X) CCUOrE 
A)), 

However/ this Is the satfe rationale that Ind us to define the 
functions DOLNF and VARF In the first place: generality versus 
specificity. The OOLNF and VARF can bo used for a wide range o^ 
tasks- The COND, two SETCls, and GO statement In LtSPEXAMPLE that 
perform the same operation are more specialized. 

Had we wished to make the FLIP ru* e that performs the 
transforation more special purpose, and correspond! ns'y faster, 
there Is a continuity available extending nil the way to wr! ■ n* 
($*$ / ((LAMBDA (A B C X) C. 1 SPEXAWPLE X))s) for the entire FLIP 
rule. In particular, we co-^d avoid the repeated cat Is to DOLVF 
by writing 

(5 // ((LAMBDA (X> (GREATER* (LENGTH X) 3)>) A $ // ((LAM3DA (X) 
(NOT (NULL X)))) 3 $3 

With a fast $, only three <ep> functions would be entered by this 
FLIP rule* Unfortunate !y, ^e would lose back so^e of the tt^ie 
gained because of the necess'ty of using the LISP Interpreter to 
evaluate the predicates (again paying for the generality of 
FLIP). If we Instead b ui . lfr a orocess of th's type I n t o FLIP/ the 
speed would be considerably Increased. 

For example, let us define a function which runs along WS looking 
for A, and then checks to see If what led up to It was longer 
than 5 In length. This v;ou*d be similar to a fast $, but with a 
$N included In It, We could call It FASTEN, We would have; to 
define FAST$N as a function of WS, PATT, MATCH/. N, and X, the 
last argument being the object of the search. 
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FAST$*J turns out to be a short four-line fanctlor) which uses NEXT 
(the ^unction celled by DOL F when It Is running In FAST model/ 
MATCH*/ IASTN/ and TCONC tc do most of the work. By Informing the 
translator that <$ n x) Is to be translated into (FASTSN H X), we 
can w*lte ((S 3 A) (S 1 3) S) for our new rule. This would be 
translated Into <<FAST$M 3 A) (FAST$N i 5) (DOLF NIL NIL NIL))/ 
and s 1 nee each FAST$N would have three <ep> 5/ the parsing wot Id 
be th*» some as that for the (S S3 A $ $1 B S) cane/ so we could 
use tl^e (1 5 U C 7) format for both. The runn:ng tine however 
would be decreased by fifty percent for tha A W X Y Z A B C D E B 
C example In the text earlier/ and by many factors for longer 
strings. We could also generalize FASTSN to allcw <form> f s end 
<nark> f s #s inputs/ and perhaps even to associate predicates with 
them. Ir thl s way we could construct a new f ull-f 1 ed#ed 
elementary pattern/ and expand the FLIP system * In this case 
towards greater ef f I cl ency. 



2,2.2 Longest Common Substring 

One of the* advantages FLIP has over COMIT and METEOR Is the 
ability tc perform searches " that are not Intrinsically left to 
right. This Is done by -mt-ans of the faMur? predicate* The 
example given below Illustrates a fairly complex use of FLIP/ #nd 
Is Included along with the LISP program to perform the same task. 
This LISP program required severa* hours to construct and defcug 
as opposed to the twenty minutes for the FLIP rule. This Is 
because there Is almost a direct translation from the algorithm 
used by both the LISP program and the FLIP rule Into the FLIP 
notat on. However/ the LISP program runs ttflce as fast as the 
FLIP program when It is corplled/ although It Is about eight 
tines as slow as FLIP when it Is Interpreted. 

The problem Is to find the longest common subs tr 1 ng of two 
strings of characters. For example/ If on* string Is (A 8 C 5 E 
F G) -md the other <CA3CEA3CFCD£FC OEF G F >), 
the longest common substrlrg Is (C D E F G> Clt takes the FLIP 
rule *5 seconds to find this string)* The algorithm which is u$ed 
by bo :h programs I s as fol lows : 

Begin from the left of one of the strings <e.g. at A) and examine 
the other string until this character Is fourd. Determine how 
long Is the common substrirg that originates here On this case 
It is A B of length 2)/ and if longer than the prevtously longest 
substr I ng (in th! s case there wasn't any)/ save the result. 
Continue looking for this character in the second string/ noting 
any longer strings found (In this case A 5 C will also.be found)/ 
until the end of the string Is reached. Then take the next 

character In the first string and continue the process. (On t v !s 
pass we will find no longer strings since there 'sn't any B C 0/ 
although there Is a 8 C, Cn the third pass, C E F Is found 
followed by C D E F G which Is ultimately the longest string.) 
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The construction of the LISP program for this algorithm Is 
straightforward Cfor LIIP programmers) although a little 
detail2d. We will trace the construction of the PUP rule from 
the al »or i tbm. 

First, It Is obvious thet w« cannot write a FLIP natch statement 
-or this purpose which will succeed I n matching, since it must 
eonelnje looking for tonger strings until Jt exhausts the string. 
(We could write a single match to look for a string longer th«n 
any given number, end then write a little 1 1 SP program which kept 
calling this FLIP rule, but this Is not as elegant, or efficient, 
as the FL1? rule which we will construct below.) Therefore we 
will W3nt to save the partial results on the allst and use a $*$ 
to pet them out. Thus our rvle win begin with $*■$ / ((LAMBDA (WS 
PATT MATCH) (PR0G2 (MATCH2 WS PATT MATCH) STRING)}), where MATCH2 
does trte matching with the rest of the rule, and STRING Is the 
name of the variable which will save the longest substring. We 

will Initially set STRING to NIL and LENGTH to X, LENGTH will be 
the length of the longest substring found so far, plus one. 

It will be a little easier to write the FLIP rule If we assune 
the two strings of characters are strung together as one list 
separated by some spec! a', character- rot In either string such ns 
***. Our first attempt at the FLIP rule Is: 

$»S / ((LAMBDA (WS PATT MATCH) (PRQG2 

(MATCH2 WS PATT MATCH) STRING)) 
(SSET STRING NIL) 
(SSET LENGTH (QUOTE 1)1 
$ (SN (* LENGTH)) S »* * S 2 

Comments: the SN locates a -string of lenjth LENGTH, since we 
might as well not consider any strings shorter. However, when we 
find a substring In the second half equal to this by means of the 
<mark> 2, It Is possible thwt this substring m^ght extend ev»n 
further. Remember in the example with (A 3 C D E F G *** CAB 
EABCFCDEFCOE=GFX)the first substring found wis 
just (A), but it actually 'rcluded (A 3:. Therefore we must 
include <eo>'s that account for this. Furthermore, we must make 
sure that the SN pattern doas not include the ***. If It does, we 
have finished the search, 

**S / ((LAMBDA (WS PATT MATCH) (PR0G2 

(MATCH2 WS PATT MATCH) STRING)) 
($SET STRING NIL) 
($SET LENGTH (QUOTE Z>> 

$ / / (YES 2) (SN (- LENGTH)) / ((LAMBDA (X) (NOT (MEMBER 

(QUOTE ***) X)))) $ **• 

S 2 % SI / (CLAM30A (X Y Z) (HOT (EOUAL (CAR X) ■•• 

(NTH Z (LENGTH Y))))> -X 5) 

Comments: the first S wit! so on as long as the $S pattern 
matches. After that it will fall, which Is what we w.int, the- 

<mark> 2 after the *** finds a substring equal to the SN. The 
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next ;; 1 nl ti al 1y matches the null segmeit. The $1 pattern 

matches with tho first character n ot eguaj to the one in the 
corresponding position o.t tie $ just befo'e the ***, It thjs 
marks the termination of ths common substr ng. Note that the 

argument 3 ignores the $*S and two $SETs i i counting which <ep> 
Is tho S before the *••• 

When $1 matches, then the <nark> 2, plus the S after it, gives 
the ntw substring. We must 31 nd the new string ard length on the 
all st and continue the search, 

$*$ / ((LAMBDA (WS PATT MATCH) (PR0G2 

(MATCH?. WS PATT MATCH) STRING)) 
<$SET STRING NIL) 
(SSET LENGTH (QUOTE 1)) 
5 / / (YES 2) ($N (» LENGTH)) / ((LAMBDA (X) (NOT 

(MEMBER (QUOTE ***) X)))) $ *** 5 2 S 
51 / ((LAM30A (X Y Z) (NOT (EQUAL (CAR X) 
(NTH Z (LENGTH Y))))) -1 3) 
($SET STRING (- APPEND -3 -21) 
(SSET LENGTH (■ AD01 (- LENGTH (= STK1NG)))) 
$ / (MILL) 

AH that remains now Is cleaning, up a few details. First, there 
Is the possibility that the longest substring might terminate at 
the erd of the list, e.g. (A 8 C *** D B C>, To keeo this rule 
simple-, let us also assume that the :wo strings are e£ch_ 
terminated by special markers, e.g. (ABC* *** D B C **), fn" 
this way wa avoid the bojndary problem. Secondly, the last $ 
causes a failure, we must decide at what point we wish the search 
to resume. Going back to tie first $ each time is obviously 
wrong because. In the event <mark> 2 does match, there may still 
be lorgcr substrings sta-tlig at the same origin In the first 
string. However, there Is no way for the $N pattern to resume the 
searcr. We must change the SN pattern Into a S pattern which 
matches a string of length LENGTH, and hav« it resume operating 
If <n;rk> 2 matches. The ru'e would thus bo: 

$*S / ((LAMBDA (WS PAT"" MATCH) (PR0G2 

(MATCH2 WS PATT HATCH) STRING)) 
($SET STRING NIL) 

(SSET LENGTH (QUOTE I)) 
S / / (YES 2) S / ((LAMBDA (X) (COND 

((MEMBER (QUOTE *) X) NIL) 
((LESSP (LENGTH X) LENGTH) (LIST NIL)) 

(T T) ))) / (YES 6) % I I (NO k) «*• S / / (NO 6) 

2 S / / (NO 8) 

51 / ((LAMBDA (X Y Z) (NOT (EQUAL (CAR X) . . 

(NTH Z (LENGTH Y))))) -1 3) 
(SSET STRING (- APPSNO -3 -2)) 

(5SET LENGTH (- ADD1 (" LENGTH (- STRING)))) 
S / (N1LL) 
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The above rule would now work In this form« However/ it would not 
be as efficient as a similar rule using fac-t <dolO's. The fast 
rule viould even be simpler/ In this particular case^ because most 
of the failure predicates us-ed above merel> check to see whethor 
or not the next <ep> has matched (the NO predicates). Since a 

fast S does not release control until the ne*xt <ep> matches 
(assuming It Is a <varf> or <do!nf>)/ we could r&olzce these 
failure predicates by predicates which JlIwc^s yteMed NIL, f,<t« 
the function NILL. Then the fast S would op orate/ matching Itself 
and the next <ep>/ release control/ and tl"en/ if control svor 
returned to It/ automatically fall* 

In addition to replacing the various NO failure predicates by 
MILL/ there Is one other chenpe that must be rnade to the above 
rule In order that It may run In FAST mode. SInco the SI th<it 
determines the end of the ccrmo^ substring uses the $ Immediately 
preceding it as an Input/ we must replace the -1 by a 0, and u*e 
<CAR Y) In the predicate as per the special convention on pa*;e 
27. Our final rule would therefore be; 

$*$ / ((LAMBDA (WS PAT7 MATCH) PR0G2 UATCH2 WS PATT MATCH) 

STRING))) 
(JSET LENGTH (QUOTE I)) 
(5SET LENGTH (QUOTE *)) 
% I I (YES 2) 
5 / ((LAMBDA (X) (CCNC 
CLESSP (LENGTH X) LENGTH) (LIST NIL)) 
CMEMBER (QUOTE ♦ ) X) \'U) 
Cf )T ))) / (YES 6) 

% I I (MILL) *** % I I (NILL) 2 $ / / (NILL) 
SI ((LAMBDA (X Y Z) (NCT (EQUAL (CAR X) 

(NTH Z (LENGTH !££&.#))))> 3) 
(SSET STRING (-= AP^O -3 -2)> 

(sSET LENGTH (* ADD1 (« LENGTH (- STRING)))) 
S / ( NILL) 

We hav? Included below a printout of the LISP function which 
performs the sane operation as the rule above. 5y way cf 
compar'son/ It runs about twice as fast as the above ru!©/ which 
In turn runs five times as fast as the rule on the previous page 
which did not utilize fast <dolf>*s. We also Include a selective 
trace of the fast r^le as an aid In vlsualitlng it operates. The 
tracing mechanism has been turned on for the first <dolf> 
following the *** <ep>/ and for the final <doif> which Induces a 
fal lure. 

In this trace/ we can see what the proposed comr*on substring !s 
by looking at the second <ep>. This Is what the <mark> 2 will 
try to match. Initially/ this Is the string (A). When the <mark>. 
2 does find zr\ (A), the rext <ep> corresponds to the rest of the 
contnon substr i ng or I gl nati ng at this point; here It is (S). Note 
that STRING Is therefore bound to (A 3). At this point, control 
goes back as far as the second <do1f> which then matches with (A 
B C). (ABC) Is also fotnd by <mark> 2/ but here the next <ep> 
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<LArnDA (A 3) (PROG ( !1 M W X D V. C) 
(SETQ tl 0) 
(SETQ X N'lL) 
Tl (SETQ C B) 

T1A (SETQ f> A) 

(SETQ E C) 
CCOMD 

((NULL 0) (RETUR'l (REVERSE X)))) 

T3 (co::d 

((EQUAL (CAR 0) (CAR E>) (10 T2))> 
(SETQ E (CHR E)> 

(conn 

((HULL E) (GQ T5)>) 
(GO T3) 
T2 (SETQ M (LIST 

(CAR n))) 
(SETQ M 1> 
T4 (SETQ D (CnR n)) 

(setq e (chs £)) 

(co:jd 

((MULL 0) (GO T6) ) 
((HULL E) (GO T6)) 

((MULL (EQUAL (CAR 0) (CAR E))> (GO T6))i 
(SETQ" W (CO'JS (CAR DJ W}) 
(SETQ M (A0D1 M)) 
(CO TU> 
T6 (COIJO 

((GREATER? M N) ( PR0G2 
(SETQ M H) 
(SETQ X W)))) 
(SETQ C (CHR O) 

(conn 

((■iOT C'ULL C>) (GO T1A)>) 
T5 (SETQ A (CHR A)> 

(GO Tl)>)) 
MIL 



A LISP program for flni'inn the lonsist common substring 
of two strings - co-ipare wlt*i FLIP rul« on pasc 37. 
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DOLF 

MATCH (MIL (A) (3CDEFG*) (***)> 3t R 

WS !C A 3 D E A 1 C f C D E F C D E F G F J ') 

A. 1ST C(G0227if) (LENGTH • 1) (SntMG)) 

D&LF 

MATCH (NIL (A) <E C I> E F G ») (*•*> (C) (A) (3) (D>) 

W5 (EAUCF CO EFCD EFGFX-) 

A-.IST (<GG227<i} (LENGTH . 3) (ST* PIG A 3)) 



DOLF 

MATC'I (NIL (A 3 C) (D E F G *) (***)) 

W3 (CAODEASCF CDEFCDEFGFK*) 

A. 1ST ((GC227fj> ( LE*!GT't . 3) (STRING A 3>) 



DOLF 

MATC'I (MIL (A 3 C) CD E F G *) (***) (C A B E) (A B C) NIL 

; : ;? 

WS (C O E F C D E F G F X •) 

A 1 - 1 ST (<G0227'O (LENGTH - fa) (STRING A R O) 



DOLF 

MATCH (NIL (A 3 C D) (E F G *) <•**)) 

WS (CA30EABCF CDEFCDEFGFX*) 

A". 1ST ((GG227L) (LE!JQTH * !*) ( ST". PIG A G C)> 



DOLF 

HATCH ((A) (ICTEXFE -) (***)> 

MS (C A R D E A H F COEFCDEFCFX 

AJST ((G0227!;) (LENGTH . »t) (STtPIG AS O) 



DOLF 

HATCH ((A 3) (C D S F) (S *) (***)) 

WS (CAHEAUFCOEFCDEFGFX') 

A. 1ST (tG0227^i) (LENGTH , It) (STRING A 3 O) 



DilLF 

MATCH ((A R)(CCE F) <G *) (***) (C A B D E A S C F) (CO 

E F) NIL (C)> 

HS (? E F fi F X •) 

ALIST C(GQ227<i> (LENGTH . 5) (STRING C F. F)) 



DOLF 

MATC" ((A 3) (C D E F G) ( +) (***)) 

WS (CABDEABCFCOEFCnEFGFX*) 

ALIST <(GG?27!i) (LENGTH . 5) (ST.TIJG CHEF)) 



QOLF 

MATC! ((A 3> (C S F C) (*) (***) CCAIHEA^CFCTE 

F) (C E F G> MIL CF)> 

VIS (X *) • 

ALIST (<G0227'i> ( LC'JCTM , 8) ( ST'IPIG C D E F G)> 

t t a n n r a * * 
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matches wl ;h NIL since the character following (A 3 C) Is F In 
the second half and In th*i first. When the final <do1f> Induces 
a failure, STRING ts (A 3 Ci and LENGTH k. Again control go *s 
back enly as far as the second <dolf> which extends its segmeic 
to lergth U / now matching '(A S C 0), However, <Tiark> 2 does not 
find this, and so control goes back to the first <do!f> Nhlch 
then rratchss with (A), (We are now midway down the page*) Tne 
second <doIf> now natches with (8C0 E>, vhlch <mar'<> 2 asa'n 
cannot find. The first <dolr> then matches with (A B), and t*ie 
second <dolf> with (C D E F). This time <*mark> finds It (tie 
first COS F>, terminated by a C> The final <dolf> passes 

control back to the second !dolf> with STR HG C E F and LENGTH 
5, This <dolf> matches with (C D E F G>, which Is also found by 
the <mark> (the second CD*: F). When the final <dolf> falls aid 
passes control back to the second <dolf>, "t tries to ma^ch with 
(C E F G *), and Its abort predicate gives a value of NIL. 
Since this <do!f> does not natch, the fir SB <dolf> also falls, by 
virtue of Us FAILURE predicate, and the value of STRING Is than 
the v*1ue of the natch, and appears at the bottom of the trace. 



■ * 
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2.3 T-anslatlon 

The purpose of mak* ng tha translation process distinct from the 
match Itself Is to avotd the necessity of Interpreting a FLIP 
rule each tine It ! s executed, and thereby dupll eating a 
considerable effort. Translation performs this ! nter pre tat ion 
only once/ and saves the results of Its Tabor by physically 
altering the list structure of Its Input- Whenever a FLIP rule Is 
a constant^ e.g. the call to FLIP Is of tha form (FLIP WS (QUCTE 
S-expressIon) (QUOTE S-expresston) ), th! s procedure saves much 
tine because trans 1 at! on, and therefor© Interpretation, Is 
necessary only the first t!^e the rule Is executed* Subsequently/ 
the translator notes the fact that this S-;xpres&!on represents a 
translated pattern* 

when a FLIP rule Is constructed within a L!SP program and then 
executed/ e.g. the call to FLIP Is of the Fprra (FLIP WS (LIST X 
Y) (LIST P Q)>, translation does not cost :he user/ even though 
It will have to be performed each tlmo, because an Interpretation 
process of sone sort must take place anyway. Translation merely 
saves the Intermediate results/ although/ in this latter case/ 
they nay never be called up3n again. 

Once a FLIP rule has been converted Into Its translated form/ the 
operaUon of MATCH Is stral ghtforward. Each Individual <ep> of 
the pattern corresponds to a function cal I and I ts arguments. 
When one <ep> matches a segment and has f:nlshed operating, It 
calls the next <ep> by means of the L!SP function APPLY/ giving 
It th*s modified WS, PATT, and MATCH, plus its own Individual 
arguments. 

One consequence of this procedure Is that t ts extremely simple 
to introduce new operations. All thot is necessary ts to define 
the correspond! ng <ep> function/ since LIS 3 APPLY Is completely 
genertjl/ and to i nform the trans! ator how to handl e the notatl on 
fn source language. In the icxt section, wa discuss how this Is 
done tirtd Introduce the $3n pattern as an e^aniple* 

The translating functions are all described in section 2.5. There 
are two rcain functions, PATTRAN and PATTRAMSPK. The Inputs to 
PATTRAN and PATTRA^iSPX are assumed to be <pattern>'s of syntactic 
typo xxx. 3oth functions return the translated version of the 
Input pattern/ as well as altering the list structure of the 
Input to correspond to It. Thus/ If the Input pattern is (S $1 S 
2 $>/ the value of PATTPAN or PATTRANSPK Is (SPATTERN ((OOLF NIL 
NIL NIL) (OOLNF I NIL) (DOLF MIL NIL NIL) CVARF *T* (MARK /T 2) 
NIL) (DOLF NIL NIL NIL))). After translation, the pointer to the 
list structure correspond! nj to (S $1 S 2 $) points to ($TRAN 
SPATTERN (COOLF >JIL NIL etc.). The special aton STRAN ts a signal 
to the translator that the fol low! ng expression has been 
translated* 

The only difference In the operation of PATTRAN and PATTRA?iSPS 
occurs when SPEAK is *T*. In this event/ both give output 
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regarding the translation. P ATT RAN gives an abbreviated for-n of 
the fanslatlon consisting merely of a list of the names of the 
<ep>' t I n the I nput pat tern. PATTRAMSPK pr I nts the entl re 
translation. Output produced by PATTRAN and PATTRANSPK for the 
tongest common substring riles In the previous section Is given 
at tha ^t\6 of this section* 

In the definitions below, ^e have adopted the convention of using 
the s/mbol * to denote trarslatlon, e.g. <sexp>* Is the internal 
representation of <sexp>. The translations of each of the i»6 
syntactic types defined In section 2*1.2 Qre listed by tful r 
corresponding numbers. Note that QUOTE and FAST nodes affect the 
translation process, the former in conjunction w: th the 
Interpretation of types xxx and vt, and the latter with regard to 
the <dolf>'s* 



I * (not appl I cable) 

1 1* <var> ■ <sexp>; <var>* a <sexp>* 

[11. Csexp> ■ <atom>; _<sexp>t * (SEXP <atom>) 

Iv. <sexp> a (QUOTE <S-express*on>); 
<sexp>* * (SEXP <S-express*on>) 

v. <scxp> = <nonllst>; <sexp>* > (SEXP <nonlist>) 

vl. <sexp> » <lfst> whose first member Is not SSET 
etc.; 

<sexp>* = (SEXP <llsr>) 

vll* <var> * <fom>; <var>* =» <f:>rm>* 

v{ II* <fom> ■ (« <S-expressIon> ); 

<form>* ■ (FORM <S-expressIon>) 

tx. <for-n> ■ (■ <fn> <var> .*. <va^>); 

<fom>* * (FORM <fn> <var>* ... <var>*) 

x. <var> • <mark>; <var>* ■ <ma*k>* 

xU <mark> ■ <nurrber>; <mark>* • (MARK /T <nunber>) 

xl 1 * <mark> ■ (<number> <markl> . .» <markl>); 

<mark>* = (MARK /T <number> <m*rkl>* . , . 
<markl>*) / same as xl v 



xJII* <narkl> • <number>|<var>; 
<markl>* * <nu;nber> J <var> 
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Since the value of a <markl> is constrained to be a number, the 
<var> Trust of necessity be n <form>» The translator detects th! & 
and causes an error If It is; not. 



xlv. <mark> • (/T <mark.'> • •■ <msrkl>>; 

<mark>* * (M/>RK /T <*ark;i>* ... <markl>*J 

xv, <nark> » (/C <merkl> • •♦ <markl>); 

<mark>* - CMA*:K /C <markl>* «.. <markl>*) 

xvl, <mark> ■ (/U <markl> ... <<narkl>); 

<merk> ■ (MARK /U <markl>* ..• <markZ>*) 

xvil* (not app1I«b1e> 

xvilt* <ep> * <varp>; <ep>* ■ <varp>* 

xtx. <varp> * <sexp>; <varp>* - (VARF NIL <sexp>* NIL) 

xx. <v$rv> * <for*>; <varp>* » (VARF NIL <form>* NIL) 

xxl , <varp> * <merk>; <ytrp>* • (/ARF *7* <mark>* NIL) 

xxll • <varp> ■ (* <var>); <varp>* • CVARF HU* <var>* 
N!L) 

xxiU. <varp> = (** <var>); <varp>* ■ (VASF *T* <var>* 
NIL) 

We use NIL Co Indicate an S ten and *T* a segment. 

xx!v, <ep> ■ <dol>; <ep>* ■ <dol>* 

xxv. <doI> - $; <dol>* ■ (OOLF NIL NIL NIL) 

If FAST is *T* at translation time, all <do!f>'s and <dol>'s are 
treated as fast. In this case xxv translates to (DOLF NIL NIL 
•T»), and Is the sane as the <do1f> $ // MIL. 

xxvl. <ep> - <dotn>; <ep>* - <do!n>* 

xxvl! . <doln> ■ Sn; <doln>* ■ CDOLMF n NIL) 

xxvl I. <do!n> = CSN <var>)j <doln>* - (OO'LNF <var>*' 
NIL) 

xxlx, <ep> «■ <pattern>; <ep>» = <pattern>* 
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xxx. <pattern> » (<ep> * • * <ep>); 

<pattern>» » (PATTERN NIL <SEXP (STRAW SPATTERS 
(<ep>* ..* <ep>*)))> 

Here <pa*t»rn> !s an <ep> Inside of another <pattern>. The val-:e 
of the <sexp> Is (STRAN SPA'TERN (<ep>* ..« <ep>*)>, so that wh 3 n 
the <ep> function evaluates It and gives i »: to PATTRAN, it gets 
back the appropriate value. 

At the top level/ the input <pettern> Is treated differently* 
Its translation Is (SPATTERN (<ep>* . # . <ep>*>). Compare this 
wl th xxx a^ova. 

xxxl. <pattern> ■ ($* <var>); 

<pattern>* » (PATTERN NIL <var>*) 

Note that if QUOTE Is NIL the second <ep> In (S CS F $) $) and 
the second <ep> In ($ (S* (CiUOTE (S F $))) $) will match the sane 
segments. However, the former will translate into (PATTERN NtL 
(SEXP (STRAN $PATTERN ((OOLF NIL- NIL NIL) (VARF MIL (SEXP F) NIL) 
(OOLF NIL N!L NIL))))) and t:he latter to (FATTERN m^SEXP ($ F 
S) ) ) * However, after both are executed once, thei r I ntern.3l 
representations will be the saTie since the ($ F S) In the latter 
<ep> Is translated In the process of execution, and therefore 
will be changed Into the former representation. 

xxxH . <oattern> ■■ ($** <var>); 

<pattern>* « (PATTERN *T* <var>*) 

xxxlll. <npred> ■ <<fn>)((<fn> <var> ... <var>); 

<npred>+ ■■ (<fn>)|(<fn> <var>* ... <var>*) 

xxxlv. <ep> = <varf>; <ep>* = <vzrf>* 

xxxv* <varf > * <vnrp> / <npred>; 

<varf>* * (VARF NIL <var>* <npred>*) or (VARF *T* 
<var>* <npred>*), depending on whether the <varp> was a 
NIL or *T* type, I,e, Item or segment. 

We have Indicated previously that when an <npred> Is MIL Its 

effects effect Is the sa^e as (LAMBDA (X) T), that I s, the <ep> 

matches anything It would without a predicate. Here we* see why. 

The <varf> with an <npred> that is NIL translates Into the sene 

form as a <varp>. I.e. a <varf> without an <nprcd>- The sane 

will be true for <doIf> vs <dol> and <do*nf> vs <doln>. Whenever 

an <npred> Is missing, or Is present but NIL, the <ep> 

degenerates i nto 1 ts slnpler counterpart. ; 
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xxxvt, <ep> ■ <do!nf>; <ep>» » <i'olnf>* 

xxxvll. <dolnf> = <doln> / <nprec>; 

<do!nf>* " (COUP n <npre<t>*) or <DOLNF <var>* 
<npred>*) depend' is on whether the <do!n> is a $n or 
<$n <var>) 

xxxvlli. <ep> ■ <cfolf>; <ep>* a <dolf>* 

xxxix. <do1f> ■ <rtol> / <npred>; 

<dolf>* ■ fOOLF <npred>* ML NIL) 

Xl. <dolf> ■ <:!ol> // <npred>; 

<dolf>* » <D0l.F <npred>* MIL *T*) 

If FAST Is *T* at translation time, al ? <dolf>'s and <dol>'s are 
translated as In fast mode. This means that the fourth member of 
the translation is *T*, as In xl above, Note that if FAST Is *T*, 
$ by Itself translates to (C-OIF Nil NIL *T*>, 

xTl. <dolf> " <dol> / <npredl> / <npred2>; 

<dolf>* • CDOLF <npredl>* <npred2>* MIL) 

xlll. <dolf> ■ <dol> // <npredl> / <npred2>; 

<dolf>* = (DOLF <npredl>* <npred?>* *T»> 

Again, setting FAST to *T* is the same as using // for the 
predicate marker. 



xliil. <<folf> - $ / / <npred>; 

<dolf>* = OQLF NIL <npred>* NIL) 

xllv. <dolf> » <dol> // / <npred>; 

<dolf>* * C03LF MIL <npred> « *T*> 

xlv. <$set> - ($SET <atom> <var>); 
<$set>* - (SS£T <atom> <var>») 

xlvl. <dol!> ■ S*S / <npred>; 

<doll>* ■ (DOLL <npred>*) 



■ t 



($••$ / ((LAMBDA. CIS PATT MATCH) (PR0G2 C1ATCH2 VIS PUT MATCH) 
STKIHfi))) €$SST LENGTH (QUOTE 1)) C$SET STRING MIL) $ / / ( 
YES 2) $ / ((LAMINA (X) (CO-ID ((LESSP ( '.EllGTH X) LE'.'GTH) (LIST MIL)) 
((MEMBER (QUOTE *) X) MIL) (T T)))> / ( fES 6) $ / / (MO U 

**•■ $ / / (mo 6) 2 $ / / an 8) si / ((..amsda (x y z) (mot 
ce(;ual (car x) (hth z (length y))))j -1 3) (sset string ( = 
append -3 -2)) (sset length <■ add1 (• lehgtm (» string)))) 

$ / c:ild> 

(coll sset sset dolf dolf oolf sex? oolf mark dolf dol'if sset 

$SET DOLF) 

Output fron PATTRAN when SPEAK is *T* 
The first list Is the Input rule - ta'ten fron pa.~e 36. 
FeHojln* It Is a list of the top lev*l <qp> functions. 
The value of PATTRAN Is Che translation of the rule. 



($*•$ / ((LAM3!\\ OS PATT MATCH) (PR0G2 '.'MATCH? WS PATT MATCH) 

STP.IMG))) (SSET LENGTH (QUOTE 1>) (SSET STRING NIL) S / / ( 

YSi. 2) 5 / ((LAI11DA (X) (COM3 ((LESSP (LEHGTH X) LEHGTH) (LIST Nil)) 

((ME.T.ER (QUOTE •) X> NIL) (T T)))) / (YES 6) $ / / (SILL) 

**«> S / / CULL) 2 S / / CULL) SI / ((LAMBDA (X Y Z> CIOT 

(EQUAL (CAS X) OTH Z ( LE:!fiTH (CAR Y)))))> 3) <$S"T STRIIIG 

(- APPE'lO -3 -2)) (SSET LEIIfiTH (= A?Ol ;= LEilGTH (- STRIMG)))) 

S / CULL)) 

(DOLL ((LAM1DA (WS PATT MATCH) ( PROG 2 (1ATCH2 WS PATT MATCH) 

STRl'IG)))) 

{$SET L5NGTH (SE\XP 1)) 

($SET STRJ'Ifl (SEXP NIL)) 

(DtlLP NIL (YES ('".ARK /T 2)) *T*> 

(OOLF ((LAMRDA (X) (COMB ((LESS 1 * (LENGTH X) LENGTH) (LIST »!1D) 

CCMEriQER (QUOTE *) X) HID (T T)))) (YES (MARK /T 6)) *!•) 

(HOLF f!IL C'ILL) -T*) 

(VARF NIL (SEXP **•) NIL) 

(POLF f'lL (MILL) *T*) 

(VARF *T* (MARK /T 2) NIL) 

(OOLF rilL (MILL) *"*) 

(DOLHF 1 ((LAMWA (X Y Z) (NOT (EQUAL (CAR X) (MTH Z (LENGTH 

<£.\R Y>))>)) (MARK /T 0) (MARK /T 3))) 

(SSET STRUG (FORM APPEND (MARK /T -3) (MARK /T -2))) 

(SSET LEMGTM (FORM Ai^l (FORM LENGTH t FOB'S STRI'IG)))) 

(HIILF (MILL) MIL *T*) 



NIL 



Output fron PATTRANSPK wh*n S«ftS\K is *T* 

The first list Is the input rule - taken fron pa«;e 37, 

FolTowTnn it ts the ccnplcte translation vfT th each <ep> 

on a separate line. Tf*e value of ?ATTRAMS?K is t^e translation. 



2. J* .''.odes of Operation 

FLIP has five noies of operation. Those correspond to ! : ive 
variables which nay be se: to *T* or Nit: SPEAK, FAST, QUOTE, 
TRACE, and EDIT. Their effect on the match is described be'ow, 
QUOTE, SPEAK, and EOIT also affoct the construct process. 

If SPEAK is NIL, PATTRAN »nd PATTRAMSPK CO not print. Otherwise 

PATTRAN prints out the input pattern and the list of the na-nef. o f 
all pf the top leve* <ep>'s. PATTRANSPK prints out the Input 
pattern and a complete listing of the translation. This is 

usefjl for debugging, 

SPEA< Is Initially set to NIL. 

If FAST Is NIL, <doI> and all <dolf>'s will be run In the normal 
way, exesot where // Is us.ed in a <do5f>. If FAST Is *T*, all 
<dolf>'s will be treated as fast, i.e. as though written with //. 
Moreover, if FAST is *T* at translation time, all <dolf>*s in the 
Input pattern will be run in fast mode regardless of what the 
value of FAST is when the rule !s executed. Thus the only way to 
have a <do'f> operate in ron-fast mode is to have FAST set to NIL 
both at translation tine and run tine, and to use a single / with 
predicates. 

FAST Is Initially set to *T*. 

If QUOTE is MIL, all lists not otherwise identified wt 11 be 

interpreted as <pattern>'s, i.e. syntactic type xxx. If QUOTE is 

*T«, all lists not otherwise identified will be Interpreted as 
<sexp>'s. I.e. syntactic type vl . 

Thus If QUOTE Is NIL, ($ (A (B O) $) becomes 

(SF'ATTERN UnOLF MIL NIL NIL) (PATTER?! NIL CSEXP (STRA.4 

SPATTERM ((VAP.F NIL (SEXP A) MID (PATTERN NIL (SEXP ($TRVI 

SPATTER?) ((VAP.F NIL (SEXP S) NIL) (VARF M J L (SEXP C) NIL)) 
))) )>) <0CIF NIL NHL HID) ) 

and (S (SI S 1) 3) becomes 

(SPATTERM (tOOLF Nil NIL .NIL) (PATTERN NIL (SEXP C$TRAN 
SPATTcftN (OOL'IF 1 .NIL) (DOLF ;J I L NIL NIL) 
(VARF »T« (MARK /T 1> NIL)) ))) COOLF NIL NIL)) ) 

If QUOTE Is *T*, (S (A (6 C>> S) b^con^s 

(3PATTERN ((DOLF NIL NIL NIL) (VARF MIL (A (3 O) NIL) 
(DOLF NIL NIL MID) ) 
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(SETTER* ((DOLF NIL NIL MIL) CVARF NIL (A C3 C>) NIL) 
(DOLF N|L NIL NIL)) ) 

and CS (SI $ 1> S> becomes 

($PATTERN ((DOLF NIL NIL NIL) (VARF NIL (SEXP (SI S 1)) NIL) 
(DOLF NIL NIL NIL)) ) 

Note that the top level pattern is always created as xxx type. 

QUOTE Is Initially set to *'>. 

TRACE Is used to follow the operation of match -we closely. If 
TRACE is »T*, the value of WS, MATCH, AL i :JT, and name of tie 
current <ep> are printed before each elementary pattern Is 
entered. If TRACE Is (DOS.NF SSET), tracing will be performed only 
before each DOLNF or SSET Is entered. If TRACE is (2 S), It will 
be performed whenver there are two or five ^unctions left to be 
executed In PATT. One can nix function names and numbers, e.s. if 
TRACE Is (3 DOLNF), then for PATT (SASS::B S 4 S), tracing 
w!l! cccur before the third S and the $2 are executed. 



If EDIT Is NIL, everything proceeds as discussed above. If EDIT 
Is *T«, all <varf>'s that a*e nonatomic <*.exp>'s are flattened 
and treated as segments, e.;j. (A (3 O) becomes (VARF *T* (SEXP 
(L* A L* B C R* R*)) MIL). The EDIT mode also affects tie 

operation of the construct orocess. It Is tseful for manipulating 
list structure as text. See the discussion of S8n pattern In 
section 2.5, and Mac Memo 23b. 



EDIT Is initially set to Nil. 
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2.5 Operation of Match 

2.5.1 Definition of Functions In HATCH 

Note: all functions described below are compiled, 

2.5.1.1 General Functions 

TCONC (X P) 

The effect of (TCONC X P) Is similar to th.it of (NCONC P (LIST 
X)), that Is X Is physically attached to the end of the list P. 
However/ TCONC Is designed so that It does not have to search for 
the end of the list ? each time. This Is done by making Its 
Input be a pointer In which (CAR P) Is the list being change*, 
and (COR P) Is the end of tie 11st. TCONC attaches X at (COR P) 
using RPLACO, and returns with a new pointer In which the value 
of the list (now with X attached to the end) Is again (CAR P) and 
(COR P) points to the new end of the list. I.e. where X is. One 
can start with P as NIL, In which case the value of (TCONC X NIL) 
Is (U) X), ready for future Input to TCONC, or with P as (NIL), 
In which case TCCNC still returns with ((X» X), but physically 
alters Its Input. The latter usage has thr: advantage that (CAR 
p ) fs sly/ays the list, rega'dless of whether or not TCCMC was 
ever entered (since In this case It gives MIL), and furthermore, 
that It is not necessary to do a SETQ each time to save the value 
of TCCNC as initializing a variable to (NIL) will suffice, 
because TCONC will then maks all changes upon the value of t"ie 
varlac 1e I tself. 



LCONC (X P) 

LCONC Is similar to TCONC e::cept that X Is a list (or else an 
error occurs) and the two lists are tied tc<gether. The value of 
LCONC is the new P. As in TCONC, P may be MIL or (NIL). 

Examples: If P Is ((A B C) 0), then (TCO!JC (QUOTE 0) P) Is ((A B 
C 0) D), and (LCONC (QUOTE \0 E F)) P) Is (<A S C E F) F). 

FIRSTN (L N) 

(FIRSTN L N) Is CONS of a list consisting cf the first n elements 
of L with the rest of L. Example: (FIRSTN (QUOTE (A 3 C E)) ;*) 
Is ((A BOD E). If L is NIL or N Is too large, the value of 
FIRSTN is NIL. If N Is not <t number, an error occurs. (N may be 
zero. In which case (FIP.STN L N) Is (LIST L). If N Is negative, 
the program will loop Indefinitely.) ' 

. • • 

LASTN CL N) 

LASTN Is similar to FIRSTN. (LASTN L N) is CONS of all of L ug to 
the last n objects with the last n. Example: (LASTN (QUOTE (A 3 C 
D E)) 3) Is ((A 3) C D E*. Roth FIRSTN and LASTN use TCC.NC, 
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last :xi 

If X :s en atom, (LAST X) is Nil. If X Is not an atom, (LAST X) 

!s thi last construct in X. Example: If X Is (A S C 0), (LAST X) 

Is (0). If X Is (A . (B . (C . D))), (LAST X) Is (C . D). 



L1STP (X) 

(LISTP X) Is «T* If X is a list or NIL. it uses LAST. 



MILL () 

NILL Is (LAMBDA Nil NIL). 



SAME (X) 

SAME li (LAMSDA (X) X). 



YES (X) 

YES i* (LAW30A 



(X) (MULL (EQ X (QUOTE FAILI-O)))) 



no (x: 

NO Is (LAM80A 



(X) (EQ X (QUOTE FAILED))), 



NEQ'JAt. (X 
NEQUAL Is 



Y) 
(LAM 3 DA 



(X Y) (MU-L (EQUAL X Y))> 



WAPPL\ 
WAPPLN 
EXPR c 
It per 
FSUSRS 
callec 
(CAS > 
spec! ; 
I ntert 
assume 
normal 
may be 
SI / ( 
MEM3SR 



(FN ARGS A) 

Is an EVALQUOTE that 



also works for 



r SU3R, It performs (4PPLY FN ARGS A> 
forms (EVAL (CONS FN ARGS) A). If FN 

except QUOTE evaluate their argu-i 
, It performs (MAPI 1ST ARGS (LAMBDA I 
)>)), and then performs (EVAL (CONS V 
Uy for YES, NO and NILL, and does 
reter In these cases. Also, FN may S 
s the second ARG is the function I 
ly be the <ep> v ). Thus (LAMBDA (XI . 

written as (DO FN X2 ... Xn). For e 
(LAMBDA (X Y Z) (MEMBER (CAR Y) Z>) 2 

(» CAR 2) 3). 



FSU3RS. If FN 
, if FN Is an 
is an FSUBR, si 
ents after th 
X) (LIST (QUOTE 
N ARGS) A). It 

not go thrcu 
e DO, In which 
the first AR3 
. . Xn) (FN X2 . 
xampl c: one may 

3) as simply S 



1 s an 
FEXPR, 

rice al! 

ey are 
QUOTE) 
checks 

gh the 

case It 
would 

.. Xn)> 
wrl te 

1 / (DO 



2,5,1,2 Translation Functions 



All of the translation functions described below have crrcful 
error controls with hopefully Illuminating diagnostic eomnants* 
Furthermore, they are straightforward enough so that the user can 
readily change them should he wish to alter or augment the 
conventions in a way other than that provided for by PATTRAN3. 



PACE US 



PATTRANSPK (PATT) 

Trans'ates and alters list structure of PA""T. 

print;, the translation. 



if SPEAK Is *T*, It 



PATT W.N CPATT) 

Translates and alters list structure of PA"T. If SPEAK Is *T*, It 

prints an abbreviated version of the translation. 



PATTRAN1 (PATT) 

Performs translation of PAT". 



PATTRAN2 CPATT) 

Translates next <ep> In PATT, returns CONS 

rest of PATT. Uses PATTRAN3. Note that next 

to five 

<npred> 



members of the list PATT, e.g.. In the case 
/ <npred>. 



of translation wi th 
<ep> nay Include up 
of ? / 



PATTRAN3 tX) 
If X Is an atom, PATTRA 
translates as an <sexp> 
QUOTE, = •, **, /C, /T, 
Into the appropriate fo 
on the property list of 
(GET UUOTE $TRAN) (CAR 
(QUOTE STRAN) (CAR X>) 
the property list as a 
(This Is the way one In 
Indicator on the proper 



translated as either a 
QUOTE to determine whlc 



N3 cal 

. If X 
/U, o 
rn as. 
STR/.N 
X)) i 
(LIST 
functl 
troduc 
ty Us 
<patte 
h. 



Is AT0MTRAN 

begins wi 

r a number, 

per section 

under the 
s not Nit, 
X) NIL), I. 
on whl ch pe 
es new conv 
t of $TRAN 
rn> or an < 



. If X Is not a list, : t 

th SSET, $*, $**, $N, 

PATTRAN3 translates : t 

2.3. Otherwise It looks 

property (CAR X). if 

It returns (APPLY (GET 

e. It uses the value on 

rforms the translation. 

enttons.) If there Is no 

under (CAR X), X is 

sexp>, and PATTRAN3 uses 



NPREDTWM (PATT PREO) 

Translates the <npred> PREO. PATT Is used for error diagnostics. 



ATOMTRAN (X) 

Translates single atom X as an <sexp> if X Is not S, S*S, Sn, cr 

a number. 



V ART RAN (VAR) 

Calls PATTRAN5 on VAR. If the result Is not an <sexp>, _<form>, or 

<mark>. It gives an error. 



NUMTRAN (X L) 

L Is a list of dibits, NUMTRAN uses PACK and NUM0S to get the 

corresponding number. If It encounters a nonnumertcal object. It 

gives an error diagnostic with X. Used for Jn <ep>, which has to 
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be unpacked to see the S cfaracter at the front. 



MARKTUN (X L) 

L Is a list of <markX>'s, r^ARKTRAN translates them sequentially. 
Recall that each <markl> must either be a number or have a number 
for i :s value. Therefore If any member of L Is neither a number 
nor a <forn>, MARKTRAN g! ves an error # 



2,5,1,3 WATCH functions 



MATCH CWS PATT) 
MATCH Is (LAMBDA 



CWS PATT) (MATCH! WS PATT NIL)) 



MATCH* (WS PATT SA) 
MATCH! Is the top level function 
However/ since PATT is essentially 
the match begins operating it does 
the only purpose of the top level 
certain variables that are SPECIAL 
the natch, SA STR and $MATCH, and 
variables nay be accessed by means 



for tha -latching operation, 
a list of function calls, once 
not require supervision* Thus 
function MATCH1 Is to set 
throughout the operation of 
then I nl :Iate the natch. These 



of 



the -unction SPES4UL. 



$A Is one of the Inputs to fATCHl and Is the allst 
throughout the natch. In order to Insure the existence o 
nonempty allst so that otle^ functions, e. .;. SSET and SSET1, 
alter It, If $A Is NIL, MATCH 1 replaces it by (CGENSYM)). 



used 

f a 

may 



$TR Is set 
Is used by 



to the value of TRACE, 
HATCH 2. 



described In section 2,b, and 



$ MATCH Is used to store 

<pattern> Is entered, (n tha 

would consist of all but the 

(P)). It Is N'lL whenever tha match Is operating 



higher level pars 
example on paj;e 16 
last parsing, <$HATCH 

on the top level 



ngs whenever a 

And 17, SNATCH 

{(0 P V) O) 



MATCH1 verifies that (CAR PATT) 
(MATCH2 WS PATT (| MATCH (WSI) ). 
the pars I ng, otherwl sc It returns 



is $PATTERN and then calls 
f match succeeds, It returns 
MIL. 



SPESHUt 


(X) 










If 


X Is 


SA, 


S MATCH 


, $TR, 


SE, 


or 


X. 


Otherwl 


se, SPE: 


5HUL g 


ives 


an 



SF, (SPESHUL X) I 
error dl agnostl Ci 



s the value of 



MATCH2 (WS PATT MATCH) 

MATCH2 performs the linkage between elementary patterns, if WS Is 
NIL, and PATT is also MIL, uho match ternlnatos successfully and 
MATCH2 returns MATCH, If WS Is NIL and PATT is not, i,e, the-e 
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are s"I U some <ep>'s left Co be matched/ the match falls ?n-d 
MATCH:: returns (LIST MATCH). Otherwise, MVTCH2 performs (APPLY 
(CAAR PATT) (APPEND (LIST WS (COR PATT) HATCH) <CDAR PATT)) NIL). 
Howev-;r, MATCH?, dees not use APPLY for 001=, VARF, 00LNF, $SET, 
PATTERN, and DOLL as It chocks for them specially so that It does 
not h.jve to go through the LISP Interprete-. 

Tracing Is also performed In MATCH2. If $TR Is *T*, tracing 
occur-; ea ch time MATCH2 Is entered and the name of the <ep>, WS, 
MATCH, "and~'$A (the allst) are printed out. If STR Is NIL, no 
tracing occurs. Otherwise $TR may be a list containing names of 
funct'ons, e.g. DOLF, SSET, or numbers which represent positions 
In PATT and hence in the rule. If (CAAR PATT), which will be the 
name of the function for the <ep> represented by (CAR PATT), is 
In th r s list, or If (LENGTH PATT) Is In this list, tracing 
occurs;. For the trace In section 2.2, TRACI, and hence STR, was 
set to (1 7), Indicating that the last elementary pattern, and 
the seventh from the last, were to be traced. 

$SET (WS PATT MATCH NAME VAR) 

Uses *SET1 to set NAME to (COPY (VARVAL VA!l MATCH)) on $A and 

then continues with MATCH2. 



SSET! (VAR NEW ALIST) 

If VAf: appears on ALIST, It reblnds its first appearance to NEW. 

Otherwise U binds VAR to NEW at the end or the ALIST. 



DOLL (WS PATT MATCH FN) 

Uses 1'APPLY with (CAR FN) and (PARGVAL (CDR FN)). FN Is presumed 

to be the translation of an <npred>. 

PARGVAL (PARGS MATCH) 

Performs MAPLIST on PARGS, a list of predicate arguments, using 

VARVAl . 



VARVAL (VAR MATCH) 

Evaluates VAR. If VAR Is a mark, It uses MATCH for current level 

parsing. Recall that VARVAL has access to the special cell $A for 

ajlst. 



MARKVAL (.MARK MATCH) 

Evaluates MARK using MATCH 3s current level parsing. Also uses 

special cell $ MATCH for higher level parsings. If SF.1i *T*, *"fc 

returns FAILED instead of g ; vlng an error if an <ep>~ does not 

exist. 
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NUMVAt (X MATCH) 

Used to evaluate a <markl>. If X Is a numbe;', value Is X. If X Is 
not a number, calls (VARVAL X MATCH), if th s Is rot a number, it 
gives an error. 



MATCH3 (WS X) 

Used by VARF. If the list < matches with a segment at the 
beginning of MS, MATCH? retu-ns (CONS X res: of WS), otherwise 
NIL. Example: WS Is (A B C E), X Is (A 8 0), value Is ((A 3 C) 
D E). 



All of the <ep> functions, VARF, DOLF, DCW, and PATTERN, have a 
similar overall effect. They determine whet'ier or not they match 
with a segment at the beginning of the MS; if net they return 
(LIST MATCH) to indicate failure. If successful, they proceed by 
call Ins MATCH2 giving it as arguments the modified WS, PATT, and 
MATCH v.-lth their <ep>* appended to it. 

VARF (WS PATT MATCH SEG VAR ^PRED) 

If SEG Is *T*, VAR Is treated as a segment/ otherwise as an item. 
VARF calls VARVAL to evaluate VAR, MATCH 3 to see If It matches 
WS, WAPPLY and PARGVAL to evaluate the NPRED If any, and then. If 
all Indicate a mate*, returns (MATCH 2 WS PATT MATCH) where WS has 
had the VARF segment removed from its front, and MATCH has had It 
appended at its end. if VARF fails to match, it -eturns (LIST 
HATCH). 



DOLNF (WS PATT MATCH N NPRED) 

Calls (NUMVAL M) to evaluate N, uses FIRSTN to get Its segment, 
and WAPPLY and PARGVAL to ovsluate the <npr;d>. If all Indicate a 
match. It calls MATCH2 etc. 



NEXT (DOL VAR WS) 

NEXT Is used by DOLF when It 
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DOLF CMS PATT MATCH NPREOl NPRED2 //) 

If PA'T Is Nil, DOLF only attempts a match with t;he rest of WS. 

!f et:her // or FAST Is *T*, 001F runs In r AST mode. If the next 
<ep> s not a <varf> or <dolnf>. It does n>t matter whether OCLF 
runs n FAST mode or not* 

When DOLF Is not In FAST mode/ It first matches with MIL/ end 
then continues to extend Its segment by taking (CAR WS) 'find 
TCONC';ng ft onto the previous segment* If there Is an abort 
predicate (the NPREOl argument)/ It applies this until It gets a 
value not NIL or (MIL)* )f It ever gets a (NIL? . It falls end 
returns (LIST MATCH). If It succeeds In matching a segment. It 
calls CMATCH2 WS PATT MATCH) with new WS and MATCH with Its 
segment appended/ and If the result indicates a successful match. 
It passes this on; otherwise It sets SF to *T* and applies its 
failure predicate (NPRED2) If any/ to decide whether or not to 
continue searching* If the decision Is favorable. It extends Its 
segment as above and the process goes on* 

If DOLF Is in fast mode, and the next <eo> Is a <varf> or 
<doln->, DOLF uses NEXT to find a match for the next <ep>, snd 
then applies the predicate for the next <es>, and its own abort 
predicate. If the predicate for the next <ep> gives NIL, It 
looks for another match for It using NEXT sgaln. If its own abort 
predicate gives MIL, it falls and returns !L1ST MATCH), If Its 
own abort predicate gives (NIL)/ It looks *or another match using 
NEXT* If everything Is favorable/ It trie* to find a natch for 
the rost of the rule by calling MATCH2. If MATCH2 yields a 
successful match, i t passer, this on/ 5therwl 55 appll es ! ts 
failure predicate. If any/ and goes on with the search for a 
match for the next <ep> uslne NEXT* Note: in the interest of 
speed,. DOLF only evaluates Its PARGS, I.e* the Inputs to Its 
abort predicate, and the PARGS of the next <ep>/ at the start of 
the search, and after each subsequent call to MATCH2* (In the 

latter case the allst may have changed*) Otherwise it knows that 
the arguments remain constant during the search for an acceptable 
match for the <dolf> and next <ep>, except for the special ccse 
where an argument, the special mark 0, refers to the segment 
matched by DOLF, 

PATTERN (WS PATT MATCH SEG PATTLIST) 

Calls VARVAL on PATTLIST, and translates the result. If SEG Is 
NIL, ' t tries to match with (CAR US). If match falls, returns 
(LIST MATCH), otherwise goes on using MATCH2. It tries the -natch 
with CCAR WS) by calling (MATCH2 (CAR WS) 'ATUlST* (SMATCH ((CAR 
WS))) ). 

If SEG Is -T*, PATTERN translates (VARVAL PATTLIST MATCH), and 
appends to this the function call (PATTERN"! SMATCH MATCH) 
followed by the rest of PATT. !t sets SMATCH to (APPEND SMATCH 
(LIST MATCH)) and calls MATCH2 on WS, this new PATT, and (SMATCH 
WS). If a fa! lure occurs. It returns LIST of the sppropri3te 
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parsing. (If <pattern> was successful, bit a failure occurred 
further on, its <eo> v will appear on this parsing. If a f al lure 
occurred insi de of <pattern> / <pattern> will not have an <ep> , 
even If so*ne of its <ep> f s did succeed*) 



PATTERN 1 (WS PATT MATCH OLDMATCH $**MATCH) 

Resets SMATCH to OLDtfATCH, 5**MATCH Is MATCH argument of PATTERN. 
PATTERN 1 appends to this MATCH, first modifying CCADR MATCH) - It 
originally Is set up as matching the ertire WS - and ca'ls 
MATCH2. tf there Is a failure/ It sets SMATCH to (APPEND S MATCH 
result of failure) so that Failure Predicates 'nslde of the 
<pattern> will work, and returns (LIST MATCH). 

PATTERN and PATTERN 1 act as an Interface between the <ep>'f 
Ir.stde of a $•* <pattern> and those on the sane level outside of 
the $•* <pattern>. PATTERr^ sets up SMATCH for the <ep>'s Inside 
the $** so they can refer to previous results by Tieans of /T or 
/U <mark> r s. PATTERS I nust restore SMATCH and group the <ep> v s of 
the <*p> f s In <pattern> Into a single parsing. If a failure 
occurs after PATTERM1, It Tust rest SMATCH before passing contro- 
back to the <ep> f s In. the <pattern> so that their Failure 
Predicates may determine the cause of failure- Similarly/ If a 
fa!Iu*e occurs after PATTERN/ it must restore SMATCH befcre 
passing control back to earlier <ep>'s. 

Because of the operation of PATTERN and PATTERU1, ($ A {$** (S 
££)) I S) will match whatever (S A $_£2 S $> natches - with a 
slightly different parsing. Also/ one can vrl te t$ A (3** (S / / 
(NO C/U 1 h)))> 9 C $>/ 2nd the S Inside of the <pattern> will 
not continue searching If a S Is found that is not followed by a 
C, exactly as for (S A $ / / (NO to) 3 C $). 



i \ 
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2.5.2 Expanding FLIP 

Secautie of the modularity of the FLIP sys :em, it Is extremely 
easy *:o Introduce new operations. Since ea*;h <ep> performs its 
Cask ->nd passes control onto the next/ the <ep>'s described above 
can bn Intermixed with arbitrary <ep> c s In:roduced by the user. 
All the user need do Is define a function and Inform the 
trans'ator how to handle the source languid* representation o* 
the new <ep> Cor else It will try to translate It Into either an 
<sexp> or a <pattern>). 

In this section we describe the development; of an <ep> which was 
deslsred tc facilitate the man! pupation of 1 1 st structure as if 
it were text. Th!s <ep> Is jseful In conjunction with editing see 
MAC Memo 2-6U, EOiT and 3REA< Functions for HSP - and Is In fact 
built Into the current FLIP system, 

2.5.2*1 Flattening Lists 

Occasionally one would like to locate a particular structure In a 
list without concern for It5 depth. For example: if X is <A 3 (C 
D E) (CF G (M (N 0)) P)).l .)>, If one is to refer to the (N 3) 
one must write <$ ({$ CS (CWOTE *(N 0))) $)) S) to refer to tie 
S-expresston at the correct depth. The internal representation of 
LISP necessitates this sort of specif I cation, stnce parentheses 
are not characters but structural symbols. However, If one 
considered X as a ,1 l.nqar st'fng of characters, locating (N 3) 
would be trivial. Therefore,, we define a function, FLATTED, which 
transforms X Into a llnea* string of characters (or atoms) 
subst I tut I n# special a tons L* and R* for left and r lg*it 
parentheses respectively, "his function In Isomorphic In a sense 
to the function PRINT which takes a list structure and converts 
It Into a linear string substituting the print-names for atoms 
and using the characters "("' and ")" to Indicate depth, Thjs 

(FLATTEN X) would be (L* A U* C D E R* I* I* F G L* M L* N > 
r# p r* r# i j r*>. now to locate (N 0) we need merely write £3 
L* N R* $). (-21-) We can then perform the necessa-y 

transformations and reconsfuct the f ? nal structure us! ng t^e 
function UMFLATTEH. Note that In particular we can delete aid 
Insert Individual parentheses. Writing (51* N R* $) for PATT 
and constructing with (1 L* L» N R* R* -i) will change CM 0) to 



ft******************************, 



(-21-) The pattern (S (** (L* N R*)) $) will also locate (N 0) 
and will run much faster since there Is only one entry to VARF to 
determine whether or not a natch with (L* N R*) occurs where 
there are four for ($ L* N R* $), Note that (S (** (L* r N 
R*)) S) has three <ep> f s and (S L+ N R* $) has six. 
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((N) U)« (The CONSTRUCT feature will be discussed In detail In 
section 3*) in fact, if EDIT Is *T*, we can simply write (S CN 
0) S) and (X <(N> 0) 3) and FLIP will automat I cally flatten (N 0) 
and (<N) 0) during translation. 



2.5.2.2 Balancing Parentheses 

The above facilities are useful because th*y provide from within 
a LISP system the features of a context editor similar to the 
CTSS command "E0 M . We would like some add tlonal sophistication 
for working with LISP; for example, we might like to be able to 
locate a structure by naming a substructure. Thus where X was CA 
8 CC D E> <(F G (M (N 0)) P>> I J) we want to be able to locate 
the structure (M (N 0)) by specifying that It cor-tains M, or (N 
0), or even just N« This Is similar to asking FLIP to locate N 
and then back up until It finds two pairs of balanced 
parentheses. 

The $Bn <ep> Is designed to serve this purpose. In the Interest 
of efficiency/ since FLIP already has a FAST facility/ we choose 
to have the $3n pattern operate after the substructure has been 
located* Thus the fast S could "locate U and then (53N 2) (since 
we want two pairs of parentheses) would say "I didn't really want 
to match with N but with the strcuture containing the structure 
containing N* so I must back up until I find two unmatched u ( !, s 
and go forward until I find their corresponding '*)"$/ and then 
mako the necessary changes In MATCH," 

When S3n is entered from the ($ N ($3U 2) S) pattern/ the parsing 
is (JHATCH C(L* A 8 L* C D E R* ...)> <L* A 3 L* C E R* L* L* F 
G L* M L*> (N)), After $3n operates/ It Is CS MATCH <(L* A S I* C 
E R« ...)) (L* A 3 L* C 3 E R* L* L* F G) CL* M L* N R* R*) 
)/ anc WS Is (P R* R* 1 J R»). Note that tie segment matched by N 
Is gone and that that matched by S has been reduced* 

To introduce such an <ep> to FLIP/ we defined a function 0OLBN/ 
of foLr variables/ WS PATT MATCH N, 00L3N searches back through 
MATCH for N unmatched L*'s, If it cannot f'r.i them/ It returns 
(LIST MATCH)* If It finds them, it looks through WS for their 
mates. If these are found/ it calls MATCH2 giving It the rest of 
WS after the matching R* f S/ PATT/ and MATCH/ In which any 
elementary patterns that now have their segments Included In that 
matched by S3n nj longer appear, and any portions of bordering 
segments Included in the $8n segment are deleted from the 
bordering elementary patterns. MATCH atso has the segment 

matched by 53n appended to It. Finally/ we inform PATTRVJ3 that 
($BN 2) translates into (DQLSN 2) by putting on the property list 
of 5TRAN under the property S3N the function (LAM33A (X) (CO^S 
(3U0TE D0LBN) (CDR X)>. FLIP Is now ready to operate with the 
$Bn pattern. 
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2.5.2,5 Editing Facilities now In FLIP 

The functions D0L5N, FLATTEN, UNFLATTEN, and FPRINT are currently 
Included In the FLIP package. The translation of SBn Is built 
Into ATOMTRAN so one may write SB2 Instead of ($9N 2) as above* 
UNFLATTEW Is programed to give an error IF the parentheses do 
not balance, and a diagnostic relating tj why they did not. 
FPRINT Is similar to PRINT, but will work on unbalanced strings. 
The user can utilize this to print a flattened structure or 
segments cf a flattened structure/ without actually having to 
UNFLATTEN them* These functions used in ED T mode allow the user 
to perform fairly sophisticated editing operations. MAC Memo 26U 
also describes some functions which use FLiP to perform editing 
of LISP functions, it should also be read by the user who will 
write his own editing functions, since It contains a much more 
detailed discussion of 00L8^, FLATTEN, UNF.ATTEM, and the use Of 
FLIP In an editing environment, and IncluJes many Illustrative 
examples. 
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3. The Construct 

The purpose of the construct process is to construct a new II it 
structure using a format anj the parsing from a match. Since tie 
flavor of the construct Is very similar to that of the match/ aid 
In fact It uses many of the same functions as the match does* 
e.g. r-ARKVAt, VARVAL, etc., It Is not necessary to go Into it In 
as great detail as the previous section. 

The Irputs to the construct process are a parsing of the fo-m 
(SMATCH <llst> ••* <llst>), a format, and an allst. The format Is 
a list of elementary format:!, or <ef>'s, which are evaluated 
sequentially fron left to right, their values being attached :o 
the list structure under construction. The similarity to the 
matching process will be evident If we return to the COMIT 
example in the Introduction: 

S+S3 + A + $*S1 + B*S * 1+E+U + 2 + C + 7 

The FLIP pattern for the left side of this rule Is (S S3 A S $1 8 
$) t Similarly the format for the right side Is (1 5 fc 2 C 7). I, 
5, 4, 2, and 7 are all <mark>*s, and their value Is computed with 
respect to the input parsing as described In section 2. C Is an 
<sexp>; Its value Is Itself, as'described in section 2. Howeve-, 
Instead of being <varp>'s, .a type of <ep>, as they are when th*y 
appear by themselves In a Oattern>, they are <efY*r> f s, which 
are a type of <ef>. However, as with <varp>'s, unless otherwise 
specified, an <efvar> that .$ a <mark> Is treated as a segment, 
and the value of the <mark> Is appended clrectly to the list 
structure being assembled. Similarly, an <£fvar> that is a <sex3> 
Is treated as an item so that (LIST <sexp> ) Is appended to t*ie 
list structure being assemb'ed. 

If WS were (AWXYZABCDEBCD) for the rule above, we saw 
that the parsing would be (SMATCH (CA W X V ...)> (A W) (X Y 2) 
(A) <B C 0) (E) (3) (C D))- The value of the <mark> 1 would be 
CA W). The value of <mark> !> would be (E). The value of tie 
<mark> k would be <B C D>, and the value of <mark> 2 would be (C 
D), The value of <sexp> C would be C. The \alue of <mark> 7 would 
be (C 3). Therefore the resuU of constructing with this parsing 
and this format would be (A W £ 3 C X Y 2 C C 3). Mote that 

the <mark> v s were appended, and List of the <sexp> was appended, 
with the result that all ware strung together at the same level. 

3.1. Notation and Definitions 



r 



The definitions of such syntactic types as <sexp>, <fofm>, etc. 

which are contained In section 2.1*2 will not be repeated here; 

Please note that the <mark> Is evaluated against the input 

parsi ng, and that negative <m3rkl>'s will therefore count 

.backwards from the end of the parsing. Since the too level 
parsing Is also the current level parsing, /U <mark> f s wIlV give 
errors. 
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1, <ef> ::= <efv*r>; <ef> v ::» <efvar> V 

IK <efvar> ;:* <sexp>; same as (* <scxp>) In match/ 
see xxi 1/ p. 17 

HI. <efvar> ::» <forn>; same as (* <form>> / see p. 17 

Iv. <efvar> ; :» <mark>; same as (** <mark>) 

v. <efvar> ::■ (* <var>); <efvar> v :;» (<var> v ) 

vl, <efvar> : :■ (** <var>); <efvar> v ;:■ <var> v 

If <var> Is not a list/ an error diagnostic occurs noting that 
an illegal segment has been used. 

v!l. <efvar> :;= <format>; <efva->* ::* <format> v 
vlil. <format> ::* (<ef> ... <ef>); 



L v 



<format> ::- same as CS* (QUOTE (<ef> 



<ef>)>) 



This assumes that QUOTE Is NIL, otherwise (<ef> ... <ef>) Is an 
<sexp> as In the case of a <pattern>. 

Ix, <format> ::» £$* <var>); 

<format> v ::» list of the renult of creating <var> v 
as a format In th* sense above.. I.e. treating each 
member of <var> v as an ;©f> to be evaluated 

sequentially and tied together, 

x, <format> ::= ($** <var>); 

<format> ::* the result of evaluating <var> as a 
<format> In the sense defined above* 



Example: If WS Is (QUOTIENT X (TIMES A El X Y Z)), PATT is 
(QUOTIENT SX (TIMES S 2 $)), and FORMAT Is (TIMES (2 2) (2 -1)) 
the result Is (TIMES A 8 Y Z). 



5.2 Translation 

The translation of an <ef> Is similar to that of an <ep>. An 
<efvar> becones (EFVAR NIL <var>«) or (EFVAR *T* <var>*J 
depending on whether the <var> I s to be treated as an I ten or as 
a segment. A <forsnat> becomes (FORMAT NIL <var>*) or (FORMAT *T* 
<VAR>*) depending on whether th$ <y?r> Is to bo treated "as 3H 
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. ~- ,.*■ as a segment. Tie functions FORMTRAN, FORMTRANSPK, 
^. m, FQRMTRAN3 are similar to PATTPAN, PATTRANSP<, 

PiTTRA'li/PATTRA«. There Is no F0RMTRAN2 since each <ef> Is 
«Mv one member of the Input format. The similarity of F0RMTRAM3 
ro PATTRAN3 extends to allowing the user to define naw 
conventions by putting the function that performs the definition 
on tbn appropriate property of the atom ST KAN. 

3.3 Modes of Operation 

FAST and TRACE do not affoct the construct process. SPEAK 

affects FORMTRAN and FORMTRANSPK In the sarc way as PATTRAN and 
PATTRANSPK. QUOTE Is slnllarly used to decide whether an 
unidentified list Is a <saxp> or a <format>. If EDIT Is NIL, all 
proceeds as before. If EDIT Is *T*, the value of each <efvar> and 
<format> Is flattened before attaching It to the list structure 
being assembled. See memo en EDIT and BREAK Functions for LISP 
for more details of editing. 

3.fc functions In CONSTRUCT 

FORMTRAN, FORKTRANSPK, FORMTRAN l\ and F0RMTRAN3 are analagous to 
the' r counterparts. 

CONSTRUCT (MATCH FORMAT) 

CONSTRUCT Is (LAMBDA (MATCH FORMAT) (C0NSTRUCT1 MATCH FORMAT 

MID). 

C0NSTRJCT1 (MATCH FORMAT $A) 

Slml lar to MATCHl, Sets $A to ((GENSYM)) If NIL and calls 

C0NSTRJCT2. 

C0NSTRJCT2 (MATCH FORMAT X) 

X Is In TCONC format. If FORMAT is NIL, returns (CAR X. . 
Otherwise It does (APPLY (WAR FORMAT) (APPENO (LIST MATCH (CDR 
FORMAT) X) (CDAR FORMAT)) NIL). 

EFVAR (MATCH FORMAT X SEG VAR) 

Soes VARVAL of VAR, and If SEG Is NIL, attaches this value to X 
by using TCONC, otherwise uses LCONC. If EDIT Is *!•, ft first 
flattens the value. Exits by calling C0NSTRUCT2. 

. •• 

FORMAT (MATCH FORMAT X SEG VAR) 

Uses (FORMTRAN (VARVAL VAR MATCH)) as a fomat and calls 
CQNSTRUCT2 to perform the construction. If SEG Is NIL, It treats 
result as I tern, and TCONCs It onto X, otherwise uses LCONC If 
EDIT Is «T» flattens result first. Exits by calling C0NSTRUCT2. 
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ft, MI seel laneous 

■■.'. Tcp Level Functions 

FLIP (WS PATT FORM) 

FLIP Is (LAMBDA (WS PATT FORM), (FLIP1 WS I'ATT FORM (LIST (LIST 

(GENSYM))))). 



FLIP1 (WS PATT FORM A) 

If (MATCH1 WS (PATTRAN PATT) A) Is successful, It saves this 
value and performs CONSTRUCT on It with (FORMTRA 1 * FORM) and A, 
and returns CONS of this value with result of construction. Note 
that the same allst Is used for both calls so that any variables 
set during the match win cirry over to the construction. FLIP1 
can be used with PATT equal to NIL, In which case It assumes WS 
Is a parsing, and just call!; C0NSTRUCT1 en WS with (FORMTRAN 
FORM) and A and returns CONS of WS wltr the result of the 
construction. If FORM Is MIL, It just calls HATCH 1 on (PATTRAN 
PATT) WS and A, and If successful returns CONS of this with NIL, 
otherwise It returns NIL. Note that CAR of the value of FLIP1 is 
alway s t he parsl ng , provided a successful rratch occurred, and C!)R 
j_s always the valu e of the ?:o.ns J.ruc tj_o n . 

■ 

FLIPR (WS PATT FORM REP) 

FLIPR is (LAMBDA (WS PATT FORM REP) (FLIPR1 WS PATT FORM Rr.P 

NIL)). 



FLIPR1 (WS PATT FORM REP A) 

FLIPR1 Is designed to repeat the application of a pattern and 
format to the WS for such problems as: remove all duplications 
from a list. The FLIP rule with PATT as (S SI S 2 S) and FORMAT 
(12 3 5) would remove only the first duplication. We would like 
to reapply It to the segment matched by the second $ and last $. 
The -Inwts to FLIPR1 that will perform this are ($ $1 $ 2 $), (1 
2), ani (3 5). A match woulc be attempted with PATT C! SI S 2 $>. 
If successful, a CONSTRUCT Kith (1 2) would occur. This value 
would be saved. Then a CONSTRUCT with (3 S) would be performed 
and another match with this and (3 $1 S 2 $) would take olace. 
This would continue until the match failed. Then the results of 
all the constructions together with the WS when the pattern 
failed would be strung together. CONS of the number of times a 
succesful match occurred with this list structure would then be 
returned. 

Example: If WS I s (A 8 C 8 C E A F), PATT Is ($ SI' S 2 $), 
FORMAT Is (1 2), and REP Is (3 5), the result will be (3 A B C - -0 
E F). ; 
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i*. 2 Loading FLIP 

FLIP Is contained In files FLIP DATA and FU PI DATA through FL1 >8 
□ATA. AM are In READ ONLY/ LINKABLE, PROTECT node In my film* 
t272 3515, You may load and compile all of these functions by 
loading FLIP DATA (computation time: appro> Inatel y 60 seconds!. 
The file FLIP SAVEO Is also In READ ONLY/ LINKASLE, PROTECT mode 
in my files and contains FLIP already loaded and compiled. 



